[ 537.637441] env[65072]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 537.637441] env[65072]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 538.659472] env[65161]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 538.659472] env[65161]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 540.227131] env[65161]: INFO neutron.common.config [-] Logging enabled! [ 540.227540] env[65161]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev74 [ 540.227750] env[65161]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65161) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 540.228151] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 540.228292] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 540.229132] env[65161]: WARNING oslo_policy.policy [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 540.229392] env[65161]: WARNING oslo_policy.policy [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 540.231133] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] VMware NSXv3 Agent initialized successfully. [ 540.231568] env[65161]: DEBUG oslo_concurrency.lockutils [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] Acquiring lock "singleton_lock" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.231718] env[65161]: DEBUG oslo_concurrency.lockutils [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] Acquired lock "singleton_lock" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.231927] env[65161]: DEBUG oslo_concurrency.lockutils [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] Releasing lock "singleton_lock" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.232235] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] Full set of CONF: {{(pid=65161) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 540.232356] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ******************************************************************************** {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 540.232444] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] Configuration options gathered from: {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 540.232806] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 540.233018] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 540.233162] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ================================================================================ {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 540.233340] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] agent_down_time = 75 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.233481] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] allow_automatic_dhcp_failover = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.233631] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] allow_bulk = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.233785] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] api_extensions_path = {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.233927] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] api_paste_config = api-paste.ini {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.234076] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] auth_strategy = keystone {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.234184] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] backdoor_port = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.234277] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] backdoor_socket = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.234431] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] backlog = 4096 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.234583] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.234766] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] bind_host = 0.0.0.0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.234950] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] bind_port = 9696 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.235140] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] client_socket_timeout = 900 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.235319] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] config_dir = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.235485] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.235704] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] config_source = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.235921] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] control_exchange = neutron {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.236161] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] core_plugin = ml2 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.236394] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] debug = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.236625] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] default_availability_zones = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.236996] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.237250] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] dhcp_agent_notification = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.237481] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] dhcp_agents_per_network = 1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.237711] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] dhcp_lease_duration = 86400 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.237947] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] dhcp_load_type = networks {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.238192] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] dns_domain = openstacklocal {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.238415] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.238640] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] enable_default_route_bfd = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.238865] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] enable_default_route_ecmp = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.239100] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] enable_dvr = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.239317] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] enable_new_agents = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.239506] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.239683] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] enable_signals = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.239858] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] enable_traditional_dhcp = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.240040] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] external_dns_driver = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.240226] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] filter_validation = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.240424] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] global_physnet_mtu = 8950 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.240630] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] graceful_shutdown_timeout = 60 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.240896] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] host = cpu-1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.241104] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] host_dvr_for_dhcp = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.241290] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] http_retries = 3 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.241515] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] instance_format = [instance: %(uuid)s] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.241661] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.241846] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ipam_driver = internal {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.242033] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ipv6_pd_enabled = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.242207] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] l3_ha = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.242408] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.242632] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] l3_ha_network_physical_name = {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.242836] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] l3_ha_network_type = {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.243044] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_color = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.243251] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_config_append = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.243455] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.243650] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_dir = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.243865] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_file = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.244058] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_options = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.244304] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_rotate_interval = 1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.244555] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_rotate_interval_type = days {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.244790] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] log_rotation_type = none {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.244967] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.245155] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.245401] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.245647] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.245866] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.246101] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] max_dns_nameservers = 5 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.246352] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] max_header_line = 16384 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.246593] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] max_l3_agents_per_router = 3 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.246821] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] max_logfile_count = 30 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.247067] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] max_logfile_size_mb = 200 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.247299] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] max_subnet_host_routes = 20 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.247556] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] my_ip = 10.180.1.21 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.247802] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] my_ipv6 = ::1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.248063] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] network_auto_schedule = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.248312] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] network_link_prefix = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.248566] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.248826] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] notify_nova_on_port_data_changes = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.249096] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] notify_nova_on_port_status_changes = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.249359] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] pagination_max_limit = -1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.249613] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] publish_errors = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.249857] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] rate_limit_burst = 0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.250131] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] rate_limit_except_level = CRITICAL {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.250384] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] rate_limit_interval = 0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.250626] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] retry_until_window = 30 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.250846] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] router_distributed = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.251075] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] rpc_resources_processing_step = 20 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.251234] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] rpc_response_max_timeout = 600 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.251398] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] rpc_response_timeout = 60 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.251543] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] send_events_interval = 2 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.251714] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] service_plugins = ['router'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.251858] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] setproctitle = on {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.251987] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] shell_completion = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.252137] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] state_path = /opt/stack/data/neutron {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.252325] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] syslog_log_facility = LOG_USER {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.252544] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] tcp_keepidle = 600 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.252761] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] transport_url = **** {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.252965] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] use_journal = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.253140] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] use_json = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.253318] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] use_ssl = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.253521] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] use_stderr = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.253747] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] use_syslog = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.253964] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] vlan_qinq = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.254165] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] vlan_transparent = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.254314] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] watch_log_file = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.254450] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] wsgi_default_pool_size = 100 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.254582] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] wsgi_keep_alive = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.254720] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.254850] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] wsgi_server_debug = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 540.254997] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_concurrency.disable_process_locking = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.255208] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.255403] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.255627] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.255851] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.256073] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.256298] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.256510] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.connection_string = messaging:// {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.256672] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.enabled = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.256818] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.es_doc_type = notification {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.256957] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.es_scroll_size = 10000 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.257111] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.es_scroll_time = 2m {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.257250] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.filter_error_trace = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.257390] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.hmac_keys = **** {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.257526] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.sentinel_service_name = mymaster {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.257670] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.socket_timeout = 0.1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.257803] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.trace_requests = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.257933] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler.trace_sqlalchemy = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.258089] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler_jaeger.process_tags = {} {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.258222] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler_jaeger.service_name_prefix = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.258358] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] profiler_otlp.service_name_prefix = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.258504] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.enforce_new_defaults = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.258782] env[65161]: WARNING oslo_config.cfg [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 540.258931] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.enforce_scope = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.259112] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.policy_default_rule = default {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.259315] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.259470] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.259618] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.259752] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.259879] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.260015] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.260160] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.260300] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.260448] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.260595] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] agent.extensions = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.260734] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.260873] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] service_providers.service_provider = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.261021] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.default_quota = -1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.261163] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.261296] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_floatingip = 50 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.261427] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_network = 100 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.261557] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_port = 500 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.261683] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.261809] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_router = 10 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.261935] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_security_group = 10 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.262075] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.262205] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.quota_subnet = 100 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.262336] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] QUOTAS.track_quota_usage = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.262480] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.262607] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep.group = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.262733] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep.helper_command = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.262862] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep.log_daemon_traceback = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.262995] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.263139] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep.thread_pool_size = 8 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.263295] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep.user = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.263490] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.263699] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_dhcp_release.group = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.263856] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_dhcp_release.helper_command = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.264028] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.264243] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.264448] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.264546] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_dhcp_release.user = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.264737] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.264824] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_ovs_vsctl.group = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.264924] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.265093] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.265257] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.265420] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.265555] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_ovs_vsctl.user = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.265702] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_namespace.capabilities = [21] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.265821] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_namespace.group = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.265948] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_namespace.helper_command = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.266091] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.266230] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.266363] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.266489] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_namespace.user = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.266673] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_conntrack.capabilities = [12] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.266810] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_conntrack.group = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.266937] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_conntrack.helper_command = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.267113] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.267269] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.267417] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.267546] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_conntrack.user = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.267686] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_link.capabilities = [12, 21] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.267813] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_link.group = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.267938] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_link.helper_command = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.268084] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_link.log_daemon_traceback = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.268222] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.268353] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_link.thread_pool_size = 8 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.268475] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] privsep_link.user = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.268623] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.268768] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.268906] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.continue_on_failed_promotions = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.269048] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.dscp = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.269202] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.dscp_inherit = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.269353] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.force_mp_to_policy = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.269486] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.locking_coordinator_url = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.269617] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.log_agent_heartbeats = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.269747] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.logging_expire = 1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.269885] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.270028] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.270174] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.polling_interval = 240 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.270314] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.270452] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.270622] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.report_interval = 30.0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.270770] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.270906] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.271054] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.271193] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.sync_skew = 60 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.271375] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.synchronization_queue_size = 20 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.271522] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT.use_helper_for_ns_read = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.271663] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] SECURITYGROUP.enable_ipset = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.271808] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] SECURITYGROUP.enable_security_group = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.271946] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.272097] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.272240] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] experimental.ipv6_pd_enabled = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.272396] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.extension_drivers = ['port_security'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.272527] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.external_network_type = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.272671] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.272845] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.overlay_ip_version = 4 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.273026] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.path_mtu = 8950 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.273179] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.physical_network_mtus = {} {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.273331] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.273525] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.273711] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ml2.type_drivers = ['vlan'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.273907] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.274095] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.274262] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.274415] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.274557] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.274698] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.274836] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.274974] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.275151] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.275383] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.275537] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_login_password = **** {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.275684] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.275823] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_login_user = admin {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.275957] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.276108] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.276244] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.276376] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.276514] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.276654] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.276794] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.276931] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.277076] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.277219] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.277364] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.277498] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.277636] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.277835] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.277978] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.278130] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.278266] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.278405] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.auth_section = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.278547] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.auth_type = password {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.278683] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.278813] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.certfile = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.278948] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.collect_timing = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.279099] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.endpoint_type = public {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.279261] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.insecure = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.279409] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.keyfile = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.279551] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.region_name = RegionOne {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.279685] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.split_loggers = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.279814] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] nova.timeout = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.279950] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.auth_section = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.280102] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.auth_type = password {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.280242] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.280372] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.certfile = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.280503] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.collect_timing = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.280640] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.endpoint_type = public {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.280772] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.insecure = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.280901] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.keyfile = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.281039] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.region_name = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.281174] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.split_loggers = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.281303] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] placement.timeout = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.281439] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.auth_section = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.281570] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.auth_type = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.281721] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.cafile = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.281871] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.certfile = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.282018] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.collect_timing = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.282154] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.connect_retries = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.282286] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.connect_retry_delay = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.282423] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.enable_notifications = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.282552] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.endpoint_override = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.282683] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.insecure = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.282811] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.interface = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.282960] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.keyfile = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.283129] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.max_version = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.283271] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.min_version = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.283417] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.region_name = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.283577] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.retriable_status_codes = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.283713] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.service_name = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.283869] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.service_type = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.284015] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.split_loggers = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.284152] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.status_code_retries = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.284284] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.status_code_retry_delay = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.284413] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.timeout = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.284545] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.valid_interfaces = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.284711] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ironic.version = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.284856] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] cli_script.dry_run = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.285007] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.285149] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.285284] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.285414] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.285543] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.285672] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.285799] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.285927] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.286066] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.286209] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.286339] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.286478] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.286616] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.286749] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.286883] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.287030] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.287168] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.287327] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.287477] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.287611] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.287757] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.287961] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.288182] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.288386] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.288583] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.288784] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.289024] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.289264] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.289498] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.289728] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.289955] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.ssl = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.290207] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.290455] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.290683] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.290901] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.291138] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.291371] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.291611] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_notifications.driver = [] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.291933] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_notifications.retry = -1 {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.292082] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.292305] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 540.292478] env[65161]: DEBUG oslo_service.backend._eventlet.service [None req-f31a8125-9edf-4e0a-8a83-c7c4d30ff883 None None] ******************************************************************************** {{(pid=65161) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 540.294122] env[65161]: DEBUG neutron.agent.securitygroups_rpc [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Init firewall settings (driver=nsxv3) {{(pid=65161) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 540.295928] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65161) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 540.296280] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] RPC agent_id: nsxm-l-01a.corp.local [ 540.299562] env[65161]: DEBUG dogpile.cache.region [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 540.299739] env[65161]: DEBUG dogpile.lock [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 540.299891] env[65161]: DEBUG dogpile.lock [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 540.300064] env[65161]: DEBUG dogpile.lock [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 540.300231] env[65161]: DEBUG dogpile.cache.region [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 540.300387] env[65161]: DEBUG dogpile.lock [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 540.300590] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 540.331523] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Session token - acquiring [ 540.333065] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.333268] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.333351] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.333793] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.345000] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.616371] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 540.640774] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 540.640963] env[65161]: DEBUG dogpile.cache.region [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Cache value generated in 0.340 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 540.641048] env[65161]: DEBUG dogpile.lock [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 540.641170] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Activating Policy API Provider. [ 540.641358] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Looking for the default Infrastructure Rules. [ 540.709405] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Looking for the Default Layer3 Logged Drop Section. [ 540.724297] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 540.724748] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.724914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.725034] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.725340] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.725686] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.239704] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.741942] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.244682] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Inventory metadata is going to be refreshed. [ 542.245072] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 542.974923] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.975273] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.975273] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.975553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.988019] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 542.988909] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.989601] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 543.006857] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.007197] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.007197] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.007530] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.007656] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.007807] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 543.007922] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.008032] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 543.028960] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.029291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.029373] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.029678] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.029860] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.030017] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 543.054019] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.054385] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.054385] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.054609] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.054749] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.054894] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 543.075186] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.075404] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.075447] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.075738] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.075879] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.076036] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 543.076144] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.076248] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 543.095414] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.095649] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.095695] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.095965] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.096105] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.096272] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 543.096376] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.096479] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 543.115524] env[65161]: DEBUG networking_nsxv3.common.locking [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.115789] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.115867] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.116188] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.116343] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.116519] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 543.116647] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.116749] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Inventory metadata have been refreshed. [ 543.116846] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Dryrun:True. Metadata refresh completed. [ 543.116962] env[65161]: DEBUG oslo_concurrency.lockutils [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Releasing lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.118599] env[65161]: INFO neutron.agent.agent_extensions_manager [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Loaded agent extensions: [] [ 543.119439] env[65161]: DEBUG neutron_lib.callbacks.manager [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65161) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 543.167558] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent RPC Daemon Started! [ 543.167664] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:0 started [ 543.167771] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent out of sync with plugin! [ 548.120526] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.120929] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.122070] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.122461] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.123856] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.124156] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.295558] env[65161]: INFO networking_nsxv3.common.synchronization [None req-3f2852cc-f2d9-4015-a16c-878677d18db3 demo admin] Enqueued Resource ID: 865f1f73-0ce5-494b-933c-a72adc5e2aed with Priority: HIGHEST for action security_group_rules [ 558.296102] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 865f1f73-0ce5-494b-933c-a72adc5e2aed with Priority: HIGHEST for action security_group_rules [ 558.296398] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-865f1f73-0ce5-494b-933c-a72adc5e2aed taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.296524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-865f1f73-0ce5-494b-933c-a72adc5e2aed" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.296587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-865f1f73-0ce5-494b-933c-a72adc5e2aed" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.296926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-865f1f73-0ce5-494b-933c-a72adc5e2aed" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.297026] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('865f1f73-0ce5-494b-933c-a72adc5e2aed',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.820486] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.820486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.820486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.820486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.820486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.820486] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 865f1f73-0ce5-494b-933c-a72adc5e2aed already deleted. [ 558.820486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-865f1f73-0ce5-494b-933c-a72adc5e2aed" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.296910] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.297305] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.123236] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.123658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.123658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.123658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.124616] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.297487] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.297698] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.626999] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.129274] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.631914] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 569.632116] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 570.423650] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.424060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.424060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.424060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.434871] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 570.435688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.436553] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 570.456031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.456256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.456256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.456441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.456527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.456630] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 570.456704] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 570.456777] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 570.476025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.476215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.476251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.476438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.476570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.476682] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 570.495074] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.495266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.495266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.495455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.495557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.495665] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 570.516293] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.516511] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.516511] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.516667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.516765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.516878] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 570.516950] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 570.517029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 570.535271] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.535474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.535474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.535669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.535754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.535862] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 570.535934] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 570.536012] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 570.558938] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.559167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.559167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.559357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.559439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.559550] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 570.559622] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 570.559744] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 570.559822] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 570.559874] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 570.559919] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 570.559984] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 570.560264] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 570.560328] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 570.560553] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 570.581505] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.581778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.581778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.581898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.582012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.582130] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 570.601465] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.601720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.601720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.601867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.601977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.615204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.298396] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 573.298743] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.299203] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 578.303239] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 583.299750] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 583.300091] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 587.611656] env[65161]: INFO networking_nsxv3.common.synchronization [None req-8b276ca9-830e-46ab-a72e-3a5ad305bd29 None None] Enqueued Resource ID: 64b5b2ba-d74b-4c35-a309-dd785960fabc with Priority: HIGHEST for action port [ 587.612818] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b5b2ba-d74b-4c35-a309-dd785960fabc with Priority: HIGHEST for action port [ 587.613236] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-64b5b2ba-d74b-4c35-a309-dd785960fabc taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.613416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64b5b2ba-d74b-4c35-a309-dd785960fabc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.613489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64b5b2ba-d74b-4c35-a309-dd785960fabc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.614410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64b5b2ba-d74b-4c35-a309-dd785960fabc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.614528] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64b5b2ba-d74b-4c35-a309-dd785960fabc',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.118447] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64b5b2ba-d74b-4c35-a309-dd785960fabc [ 588.119832] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.119832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.119832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.119832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.119832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.119832] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64b5b2ba-d74b-4c35-a309-dd785960fabc already deleted. [ 588.119832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64b5b2ba-d74b-4c35-a309-dd785960fabc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.658744] env[65161]: INFO networking_nsxv3.common.synchronization [None req-934a65e6-e1a9-49b5-a5b7-9c1aa21fb443 None None] Enqueued Resource ID: 4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba with Priority: HIGHEST for action port [ 589.659031] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba with Priority: HIGHEST for action port [ 589.659583] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.659749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.659849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.660020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.663076] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.166224] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba [ 590.166224] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.166224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.166224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.166224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.166224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.166224] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba already deleted. [ 590.166224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4be2b6e2-2ceb-4bc2-8bbc-ddb2cad112ba" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.548034] env[65161]: INFO networking_nsxv3.common.synchronization [None req-4b3c8ea2-6210-4394-9857-1e17d5c8ebda None None] Enqueued Resource ID: 039822f7-1be8-4697-9f60-e8161dc2a2fe with Priority: HIGHEST for action port [ 590.548034] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039822f7-1be8-4697-9f60-e8161dc2a2fe with Priority: HIGHEST for action port [ 590.548034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-039822f7-1be8-4697-9f60-e8161dc2a2fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.548034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-039822f7-1be8-4697-9f60-e8161dc2a2fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.548034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-039822f7-1be8-4697-9f60-e8161dc2a2fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.549225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-039822f7-1be8-4697-9f60-e8161dc2a2fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.549348] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('039822f7-1be8-4697-9f60-e8161dc2a2fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.052898] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 039822f7-1be8-4697-9f60-e8161dc2a2fe [ 591.053451] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.053607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.053815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.053910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.053993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.054100] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:039822f7-1be8-4697-9f60-e8161dc2a2fe already deleted. [ 591.054179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-039822f7-1be8-4697-9f60-e8161dc2a2fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.202878] env[65161]: INFO networking_nsxv3.common.synchronization [None req-96fb9671-89a9-4c17-8761-4c483ad531c5 None None] Enqueued Resource ID: c5e426be-7daa-4f5f-a673-e0019fdd8dc8 with Priority: HIGHEST for action port [ 591.203395] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5e426be-7daa-4f5f-a673-e0019fdd8dc8 with Priority: HIGHEST for action port [ 591.205868] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5e426be-7daa-4f5f-a673-e0019fdd8dc8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.205868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5e426be-7daa-4f5f-a673-e0019fdd8dc8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.205868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5e426be-7daa-4f5f-a673-e0019fdd8dc8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.205868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5e426be-7daa-4f5f-a673-e0019fdd8dc8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.205868] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e426be-7daa-4f5f-a673-e0019fdd8dc8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.709092] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5e426be-7daa-4f5f-a673-e0019fdd8dc8 [ 591.710092] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.710092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.710092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.710092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.710092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.710092] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5e426be-7daa-4f5f-a673-e0019fdd8dc8 already deleted. [ 591.710092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5e426be-7daa-4f5f-a673-e0019fdd8dc8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.959473] env[65161]: INFO networking_nsxv3.common.synchronization [None req-3b4b5a42-6ac3-4682-aa6d-bb9500d95689 None None] Enqueued Resource ID: 390bf940-2386-42c4-8125-586d3bdc8c23 with Priority: HIGHEST for action port [ 591.959473] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390bf940-2386-42c4-8125-586d3bdc8c23 with Priority: HIGHEST for action port [ 591.959473] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-390bf940-2386-42c4-8125-586d3bdc8c23 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.959473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-390bf940-2386-42c4-8125-586d3bdc8c23" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.959473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-390bf940-2386-42c4-8125-586d3bdc8c23" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.959473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-390bf940-2386-42c4-8125-586d3bdc8c23" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.959473] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('390bf940-2386-42c4-8125-586d3bdc8c23',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.322651] env[65161]: INFO networking_nsxv3.common.synchronization [None req-b097e3e7-db15-4cd4-aa5c-658f4ea7f0f1 None None] Enqueued Resource ID: 7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a with Priority: HIGHEST for action port [ 592.323714] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a with Priority: HIGHEST for action port [ 592.323714] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.323714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.323714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.323921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.323975] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.464328] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 390bf940-2386-42c4-8125-586d3bdc8c23 [ 592.464328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.464895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.464895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.464895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.464895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.465051] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:390bf940-2386-42c4-8125-586d3bdc8c23 already deleted. [ 592.465051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-390bf940-2386-42c4-8125-586d3bdc8c23" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.829882] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a [ 592.830162] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.830309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.830377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.830998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.830998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.830998] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a already deleted. [ 592.830998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c7ba8df-01b4-4b90-bffe-4dcd7ea2980a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.108037] env[65161]: INFO networking_nsxv3.common.synchronization [None req-4ded8da9-8821-4ea7-b4db-0cfdbecb62f2 None None] Enqueued Resource ID: e2f838c8-5319-4a33-87b6-dbe30d134b23 with Priority: HIGHEST for action port [ 593.108037] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f838c8-5319-4a33-87b6-dbe30d134b23 with Priority: HIGHEST for action port [ 593.108037] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2f838c8-5319-4a33-87b6-dbe30d134b23 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.109754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2f838c8-5319-4a33-87b6-dbe30d134b23" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.109754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2f838c8-5319-4a33-87b6-dbe30d134b23" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.109754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2f838c8-5319-4a33-87b6-dbe30d134b23" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.109754] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2f838c8-5319-4a33-87b6-dbe30d134b23',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.150760] env[65161]: INFO networking_nsxv3.common.synchronization [None req-df8e2851-a74f-4915-a8e6-cea32b79126e None None] Enqueued Resource ID: c3eb5c56-f058-40a6-b5e4-54fea5713c79 with Priority: HIGHEST for action port [ 593.151465] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3eb5c56-f058-40a6-b5e4-54fea5713c79 with Priority: HIGHEST for action port [ 593.152058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3eb5c56-f058-40a6-b5e4-54fea5713c79 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.152058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3eb5c56-f058-40a6-b5e4-54fea5713c79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.152058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3eb5c56-f058-40a6-b5e4-54fea5713c79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.152058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3eb5c56-f058-40a6-b5e4-54fea5713c79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.154900] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3eb5c56-f058-40a6-b5e4-54fea5713c79',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.611602] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2f838c8-5319-4a33-87b6-dbe30d134b23 [ 593.613144] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.613318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.613584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.613584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.613684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.613748] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2f838c8-5319-4a33-87b6-dbe30d134b23 already deleted. [ 593.613969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2f838c8-5319-4a33-87b6-dbe30d134b23" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.658731] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3eb5c56-f058-40a6-b5e4-54fea5713c79 [ 593.658731] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.658731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.658731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.658731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.658731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.658731] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3eb5c56-f058-40a6-b5e4-54fea5713c79 already deleted. [ 593.658731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3eb5c56-f058-40a6-b5e4-54fea5713c79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.787649] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c3460980-1513-4a0b-ab97-adcf8622068e None None] Enqueued Resource ID: 86db9dd3-0292-410f-a37b-c78a8af1cd18 with Priority: HIGHEST for action port [ 594.788310] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86db9dd3-0292-410f-a37b-c78a8af1cd18 with Priority: HIGHEST for action port [ 594.788958] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-86db9dd3-0292-410f-a37b-c78a8af1cd18 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.788958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86db9dd3-0292-410f-a37b-c78a8af1cd18" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.788958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86db9dd3-0292-410f-a37b-c78a8af1cd18" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.790879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86db9dd3-0292-410f-a37b-c78a8af1cd18" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.791689] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86db9dd3-0292-410f-a37b-c78a8af1cd18',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.295651] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86db9dd3-0292-410f-a37b-c78a8af1cd18 [ 595.296526] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.297390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.297390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.297725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.297725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.297725] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86db9dd3-0292-410f-a37b-c78a8af1cd18 already deleted. [ 595.297888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86db9dd3-0292-410f-a37b-c78a8af1cd18" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.819088] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c9ef6800-149a-48d3-bdea-d5954d3d4474 None None] Enqueued Resource ID: f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd with Priority: HIGHEST for action port [ 596.820116] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd with Priority: HIGHEST for action port [ 596.821054] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.821054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.821054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.822361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.822361] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.885066] env[65161]: INFO networking_nsxv3.common.synchronization [None req-61426eee-3124-433d-8b2a-e4f8d06ead64 None None] Enqueued Resource ID: b7cd7960-0db4-4b89-877d-936d4bc54d08 with Priority: HIGHEST for action port [ 596.885608] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7cd7960-0db4-4b89-877d-936d4bc54d08 with Priority: HIGHEST for action port [ 596.885922] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7cd7960-0db4-4b89-877d-936d4bc54d08 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.890205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7cd7960-0db4-4b89-877d-936d4bc54d08" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.890205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7cd7960-0db4-4b89-877d-936d4bc54d08" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.890205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7cd7960-0db4-4b89-877d-936d4bc54d08" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.890205] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7cd7960-0db4-4b89-877d-936d4bc54d08',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.325171] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd [ 597.325171] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.325553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.325553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.325553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.325553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.325553] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd already deleted. [ 597.325553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f167c6e8-9b72-4dfd-9d29-02e5d7ed12cd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.391441] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7cd7960-0db4-4b89-877d-936d4bc54d08 [ 597.392522] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.392522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.392522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.392522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.392522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.392731] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7cd7960-0db4-4b89-877d-936d4bc54d08 already deleted. [ 597.392731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7cd7960-0db4-4b89-877d-936d4bc54d08" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.465829] env[65161]: INFO networking_nsxv3.common.synchronization [None req-964e0e53-f2d4-4501-870c-47ee55de376f None None] Enqueued Resource ID: 439b00f8-a73a-43ab-8a0c-a7f27afd49db with Priority: HIGHEST for action port [ 597.466418] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 439b00f8-a73a-43ab-8a0c-a7f27afd49db with Priority: HIGHEST for action port [ 597.466722] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-439b00f8-a73a-43ab-8a0c-a7f27afd49db taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.466851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-439b00f8-a73a-43ab-8a0c-a7f27afd49db" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.466921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-439b00f8-a73a-43ab-8a0c-a7f27afd49db" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.470045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-439b00f8-a73a-43ab-8a0c-a7f27afd49db" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.470045] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('439b00f8-a73a-43ab-8a0c-a7f27afd49db',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.598952] env[65161]: INFO networking_nsxv3.common.synchronization [None req-04458380-dfc8-43fe-8d28-adf6a31863ef tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_rules [ 597.598952] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_rules [ 597.600754] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f835b02-6879-4c48-95a4-22113f8049b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.600754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.600754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.600754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.600754] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.925270] env[65161]: INFO networking_nsxv3.common.synchronization [None req-ce4a4273-5a3d-48e0-8c87-29894ecb9234 None None] Enqueued Resource ID: d6b1337f-5982-4fd8-be13-baa6d2a2a76e with Priority: HIGHEST for action port [ 597.925495] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b1337f-5982-4fd8-be13-baa6d2a2a76e with Priority: HIGHEST for action port [ 597.925985] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6b1337f-5982-4fd8-be13-baa6d2a2a76e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.926149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6b1337f-5982-4fd8-be13-baa6d2a2a76e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.926214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6b1337f-5982-4fd8-be13-baa6d2a2a76e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.926880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6b1337f-5982-4fd8-be13-baa6d2a2a76e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.927110] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b1337f-5982-4fd8-be13-baa6d2a2a76e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.970282] env[65161]: INFO networking_nsxv3.common.synchronization [None req-f7d3d663-f69e-4971-b222-b3a3f3665825 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_rules [ 597.971821] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_rules [ 597.971964] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 439b00f8-a73a-43ab-8a0c-a7f27afd49db [ 597.972284] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.972429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.972486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.972685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.972798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.972886] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:439b00f8-a73a-43ab-8a0c-a7f27afd49db already deleted. [ 597.972943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-439b00f8-a73a-43ab-8a0c-a7f27afd49db" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.973163] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f835b02-6879-4c48-95a4-22113f8049b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.973392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.123062] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.124641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.124641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.124641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.124641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.124641] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f835b02-6879-4c48-95a4-22113f8049b5 already deleted. [ 598.124641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.124641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.124641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.124641] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.430202] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6b1337f-5982-4fd8-be13-baa6d2a2a76e [ 598.430756] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.430985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.431107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.431589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.431770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.431929] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6b1337f-5982-4fd8-be13-baa6d2a2a76e already deleted. [ 598.432102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6b1337f-5982-4fd8-be13-baa6d2a2a76e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.645964] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.647623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.647623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.647623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.647623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.647623] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f835b02-6879-4c48-95a4-22113f8049b5 already deleted. [ 598.647623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.865359] env[65161]: INFO networking_nsxv3.common.synchronization [None req-33555b49-9ec0-4c10-98a7-5f9e15d71333 None None] Enqueued Resource ID: 87fe8b62-8a86-434b-a817-1c8d20800883 with Priority: HIGHEST for action port [ 598.865630] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87fe8b62-8a86-434b-a817-1c8d20800883 with Priority: HIGHEST for action port [ 598.866209] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-87fe8b62-8a86-434b-a817-1c8d20800883 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.866369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87fe8b62-8a86-434b-a817-1c8d20800883" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.866536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87fe8b62-8a86-434b-a817-1c8d20800883" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.866647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87fe8b62-8a86-434b-a817-1c8d20800883" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.866728] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87fe8b62-8a86-434b-a817-1c8d20800883',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.369980] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87fe8b62-8a86-434b-a817-1c8d20800883 [ 599.369980] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.369980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.369980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.369980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.369980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.369980] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87fe8b62-8a86-434b-a817-1c8d20800883 already deleted. [ 599.369980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87fe8b62-8a86-434b-a817-1c8d20800883" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.895574] env[65161]: INFO networking_nsxv3.common.synchronization [None req-32b38547-f738-4f50-bd29-1c3182e8fe1d None None] Enqueued Resource ID: f15d643d-4393-49de-bfbe-cfffec805e10 with Priority: HIGHEST for action port [ 599.896426] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f15d643d-4393-49de-bfbe-cfffec805e10 with Priority: HIGHEST for action port [ 599.896426] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f15d643d-4393-49de-bfbe-cfffec805e10 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.898372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f15d643d-4393-49de-bfbe-cfffec805e10" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.898372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f15d643d-4393-49de-bfbe-cfffec805e10" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.898372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f15d643d-4393-49de-bfbe-cfffec805e10" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.898372] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f15d643d-4393-49de-bfbe-cfffec805e10',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.403672] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f15d643d-4393-49de-bfbe-cfffec805e10 [ 600.403672] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.403672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.404094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.404094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.404094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.404094] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f15d643d-4393-49de-bfbe-cfffec805e10 already deleted. [ 600.404202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f15d643d-4393-49de-bfbe-cfffec805e10" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.685474] env[65161]: INFO networking_nsxv3.common.synchronization [req-44d61d34-0f77-442f-afde-8856f9703dea req-7a9f18fb-56f0-4bb1-8a6c-99b8a28c8f2f tempest-AttachInterfacesV270Test-554144948 tempest-AttachInterfacesV270Test-554144948-project-member] Enqueued Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGHEST for action security_group_members [ 600.685959] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGHEST for action security_group_members [ 600.686273] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.686395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.686462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.686709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.686866] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.686965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.687268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.687499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.687770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.687770] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.141851] env[65161]: INFO networking_nsxv3.common.synchronization [None req-56f32fa8-0ad4-42dc-8e09-84a70a832dc1 None None] Enqueued Resource ID: edf4958f-558d-429d-9185-7a7e7a624211 with Priority: HIGHEST for action port [ 601.141851] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edf4958f-558d-429d-9185-7a7e7a624211 with Priority: HIGHEST for action port [ 601.142025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-edf4958f-558d-429d-9185-7a7e7a624211 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.142025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edf4958f-558d-429d-9185-7a7e7a624211" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.142383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edf4958f-558d-429d-9185-7a7e7a624211" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.143370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edf4958f-558d-429d-9185-7a7e7a624211" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.143370] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edf4958f-558d-429d-9185-7a7e7a624211',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.190062] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.190223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.190223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.190393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.190488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.190671] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.190765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.190831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.192305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.192305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.192305] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf already deleted. [ 601.192305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.519421] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.519421] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-796" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.519421] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-796" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.519907] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-796" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.519907] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.520091] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.520212] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.521497] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.521497] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.521497] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.521497] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.521497] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.521497] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.521497] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.521497] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.521497] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.544230] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.544324] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.544399] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.544699] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-796" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.547720] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-6d11908e-3eb2-4c60-8530-7ebcc59d9661 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.547873] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-6d11908e-3eb2-4c60-8530-7ebcc59d9661" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.547974] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-6d11908e-3eb2-4c60-8530-7ebcc59d9661" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.548345] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-6d11908e-3eb2-4c60-8530-7ebcc59d9661" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.548487] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d11908e-3eb2-4c60-8530-7ebcc59d9661',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.635070] env[65161]: INFO networking_nsxv3.common.synchronization [None req-a935192c-5514-4fdc-9925-168fbdcef402 tempest-ServerActionsV293TestJSON-816812624 tempest-ServerActionsV293TestJSON-816812624-project-member] Enqueued Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_rules [ 601.635610] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_rules [ 601.635911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e16b48c-6389-4032-9e70-091f52c4106a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.636345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.636421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.636668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.636753] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.644912] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edf4958f-558d-429d-9185-7a7e7a624211 [ 601.645124] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.645249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.645318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.645505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.645655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.645696] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edf4958f-558d-429d-9185-7a7e7a624211 already deleted. [ 601.645752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edf4958f-558d-429d-9185-7a7e7a624211" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.979705] env[65161]: INFO networking_nsxv3.common.synchronization [None req-ce44f201-ffb9-467f-921b-fddf8a082348 tempest-ServerActionsV293TestJSON-816812624 tempest-ServerActionsV293TestJSON-816812624-project-member] Enqueued Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_rules [ 601.981753] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_rules [ 601.981753] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e16b48c-6389-4032-9e70-091f52c4106a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.981753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.052322] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.052502] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.052667] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.053615] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.053615] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.053615] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 6d11908e-3eb2-4c60-8530-7ebcc59d9661 not found, creating... [ 602.053615] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.053615] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.053815] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.054021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.054021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.054379] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.054530] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.054642] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.055143] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.055143] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.055143] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 6d11908e-3eb2-4c60-8530-7ebcc59d9661 is going to be created. [ 602.079580] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.079580] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.079580] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.079580] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.079580] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.079580] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-6d11908e-3eb2-4c60-8530-7ebcc59d9661" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.162285] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.162458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.162525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.162740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.162834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.163194] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e16b48c-6389-4032-9e70-091f52c4106a already deleted. [ 602.163194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.163194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.163387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.163421] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.500594] env[65161]: INFO networking_nsxv3.common.synchronization [None req-e40bab46-f84e-41a6-b5e0-b4a2449d42b9 None None] Enqueued Resource ID: 77d62fd7-f8e1-4e68-b09d-40784309d025 with Priority: HIGHEST for action port [ 602.500846] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77d62fd7-f8e1-4e68-b09d-40784309d025 with Priority: HIGHEST for action port [ 602.501419] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-77d62fd7-f8e1-4e68-b09d-40784309d025 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.501552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77d62fd7-f8e1-4e68-b09d-40784309d025" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.501621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77d62fd7-f8e1-4e68-b09d-40784309d025" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.501865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77d62fd7-f8e1-4e68-b09d-40784309d025" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.501948] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77d62fd7-f8e1-4e68-b09d-40784309d025',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.684784] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.685219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.685219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.685219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.685698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.685698] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e16b48c-6389-4032-9e70-091f52c4106a already deleted. [ 602.685698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.747346] env[65161]: INFO networking_nsxv3.common.synchronization [req-95038231-4d9f-4217-9b43-b9f9a040a45d req-1837f8b0-2c2f-4989-89fe-8b43e43992ee tempest-DeleteServersAdminTestJSON-344791916 tempest-DeleteServersAdminTestJSON-344791916-project-member] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 602.747879] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 602.748204] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.748339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.748403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.748641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.748797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.748896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.748963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.749328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.749422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.749519] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.892607] env[65161]: INFO networking_nsxv3.common.synchronization [req-44d61d34-0f77-442f-afde-8856f9703dea req-56612685-3819-4704-97db-c0436bf0d3ba service nova] Enqueued Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGHEST for action security_group_rules [ 602.892779] env[65161]: INFO networking_nsxv3.common.synchronization [req-44d61d34-0f77-442f-afde-8856f9703dea req-56612685-3819-4704-97db-c0436bf0d3ba service nova] Enqueued Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGHEST for action security_group_members [ 602.892935] env[65161]: INFO networking_nsxv3.common.synchronization [req-44d61d34-0f77-442f-afde-8856f9703dea req-56612685-3819-4704-97db-c0436bf0d3ba service nova] Enqueued Resource ID: 6d11908e-3eb2-4c60-8530-7ebcc59d9661 with Priority: HIGHEST for action port [ 602.893541] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGHEST for action security_group_rules [ 602.893605] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGHEST for action security_group_members [ 602.893688] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d11908e-3eb2-4c60-8530-7ebcc59d9661 with Priority: HIGHEST for action port [ 602.893975] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.897034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.897034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.897034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.897034] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.897620] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.897758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.897814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.899030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.899030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.899030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.899030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.899030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.899030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.899030] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.901915] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d11908e-3eb2-4c60-8530-7ebcc59d9661 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.902054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d11908e-3eb2-4c60-8530-7ebcc59d9661" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.902173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d11908e-3eb2-4c60-8530-7ebcc59d9661" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.902590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d11908e-3eb2-4c60-8530-7ebcc59d9661" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.902590] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d11908e-3eb2-4c60-8530-7ebcc59d9661',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.005365] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77d62fd7-f8e1-4e68-b09d-40784309d025 [ 603.005365] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.005365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.005365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.005365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.005365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.005365] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77d62fd7-f8e1-4e68-b09d-40784309d025 already deleted. [ 603.005365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77d62fd7-f8e1-4e68-b09d-40784309d025" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.252463] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.252693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.252693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.252916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.253024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.253704] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.254102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.254102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.254273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.254273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.254273] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 already deleted. [ 603.254410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.406881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.406881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.417495] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.418800] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d11908e-3eb2-4c60-8530-7ebcc59d9661 with status ACTIVE [ 603.418970] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.419122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.419193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.419463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.419554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.419734] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.419835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.419897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.420080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.420185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.420354] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.420456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.420534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.420696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.420773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.420859] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d11908e-3eb2-4c60-8530-7ebcc59d9661 is going to be updated. [ 603.445091] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.445314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.445314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.445694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.445868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.446109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d11908e-3eb2-4c60-8530-7ebcc59d9661" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.827860] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.827860] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.827860] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.828298] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.828332] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.828482] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.828593] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.828806] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.828942] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.829167] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.829316] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.830327] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.830327] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.830327] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.830327] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.830327] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.849205] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.849412] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.850857] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.851081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.851399] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.851623] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.851726] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.852081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.852974] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a60907b-ee0e-4208-8b57-ba7e21c0ca63',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.919171] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.178750] env[65161]: INFO networking_nsxv3.common.synchronization [None req-165074bc-a0da-4c08-a4e0-4ef8116dc511 None None] Enqueued Resource ID: a0536b00-b57a-4aaf-82f5-9995c1b11bf8 with Priority: HIGHEST for action port [ 604.179326] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0536b00-b57a-4aaf-82f5-9995c1b11bf8 with Priority: HIGHEST for action port [ 604.180468] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0536b00-b57a-4aaf-82f5-9995c1b11bf8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.180468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0536b00-b57a-4aaf-82f5-9995c1b11bf8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.180468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0536b00-b57a-4aaf-82f5-9995c1b11bf8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.180468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0536b00-b57a-4aaf-82f5-9995c1b11bf8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.180468] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0536b00-b57a-4aaf-82f5-9995c1b11bf8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.355988] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.356234] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.356358] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.356621] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.356762] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.356907] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 0a60907b-ee0e-4208-8b57-ba7e21c0ca63 not found, creating... [ 604.357171] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.357320] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.357431] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.357634] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.357764] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.358435] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.358435] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.358435] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.358616] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.358724] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.358850] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 0a60907b-ee0e-4208-8b57-ba7e21c0ca63 is going to be created. [ 604.378207] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.378683] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.378683] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.378808] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.379030] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.379251] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.423218] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.423780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.423780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.423780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.423780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.423945] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf is going to be created. [ 604.456939] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.457088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.457165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.457490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.457662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.468539] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf in Status: UNINITIALIZED for 2s [ 604.686060] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0536b00-b57a-4aaf-82f5-9995c1b11bf8 [ 604.686296] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.686439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.686513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.686717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.686809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.687737] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0536b00-b57a-4aaf-82f5-9995c1b11bf8 already deleted. [ 604.687737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0536b00-b57a-4aaf-82f5-9995c1b11bf8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.105879] env[65161]: INFO networking_nsxv3.common.synchronization [req-95038231-4d9f-4217-9b43-b9f9a040a45d req-7bf17e36-50e2-4ffb-974e-b132f56861e6 service nova] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_rules [ 605.106157] env[65161]: INFO networking_nsxv3.common.synchronization [req-95038231-4d9f-4217-9b43-b9f9a040a45d req-7bf17e36-50e2-4ffb-974e-b132f56861e6 service nova] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 605.106206] env[65161]: INFO networking_nsxv3.common.synchronization [req-95038231-4d9f-4217-9b43-b9f9a040a45d req-7bf17e36-50e2-4ffb-974e-b132f56861e6 service nova] Enqueued Resource ID: 0a60907b-ee0e-4208-8b57-ba7e21c0ca63 with Priority: HIGHEST for action port [ 605.106409] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_rules [ 605.106536] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 605.106631] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a60907b-ee0e-4208-8b57-ba7e21c0ca63 with Priority: HIGHEST for action port [ 605.107194] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.107321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.107388] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.107638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.107719] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.111646] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.111991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.111991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.112155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.112411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.113983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.113983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.113983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.113983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.113983] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.113983] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.115598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.115674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.115674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.115674] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a60907b-ee0e-4208-8b57-ba7e21c0ca63',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.613178] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.613178] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.618263] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.623018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a60907b-ee0e-4208-8b57-ba7e21c0ca63 with status ACTIVE [ 605.623018] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.623018] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.623018] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.623018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.623018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a60907b-ee0e-4208-8b57-ba7e21c0ca63 is going to be updated. [ 605.646609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.646609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.646609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.646609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.646609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.646609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a60907b-ee0e-4208-8b57-ba7e21c0ca63" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.657028] env[65161]: INFO networking_nsxv3.common.synchronization [None req-0161555d-2d71-4ca6-b6ff-7694c3004fa3 None None] Enqueued Resource ID: 5f557ef5-1ffd-4b76-8867-8f8a75c453af with Priority: HIGHEST for action port [ 605.657028] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f557ef5-1ffd-4b76-8867-8f8a75c453af with Priority: HIGHEST for action port [ 605.657028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f557ef5-1ffd-4b76-8867-8f8a75c453af taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.657028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f557ef5-1ffd-4b76-8867-8f8a75c453af" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.657028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f557ef5-1ffd-4b76-8867-8f8a75c453af" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.657028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f557ef5-1ffd-4b76-8867-8f8a75c453af" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.657028] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f557ef5-1ffd-4b76-8867-8f8a75c453af',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.121977] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.159604] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f557ef5-1ffd-4b76-8867-8f8a75c453af [ 606.159831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.159975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.160058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.160340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.160432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.160527] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f557ef5-1ffd-4b76-8867-8f8a75c453af already deleted. [ 606.160607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f557ef5-1ffd-4b76-8867-8f8a75c453af" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.481675] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf in Status: SUCCESS [ 606.481675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.481675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.481675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.481675] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.481675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.481675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.481675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.481675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.482482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.482482] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.548881] env[65161]: INFO networking_nsxv3.common.synchronization [req-a73d6022-82d8-491f-a806-0d7373aaad01 req-49238171-c585-4ffc-be7b-0a067c4c7b82 tempest-ServersAdminNegativeTestJSON-1398107905 tempest-ServersAdminNegativeTestJSON-1398107905-project-member] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 606.549384] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 606.549791] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.549791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.549941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.550744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.550744] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.550840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.550918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.551096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.551351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.551639] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.623527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.623707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.623773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.624080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.624080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.624230] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 is going to be created. [ 606.648194] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.648393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.648447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.648626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.648769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.662071] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: UNINITIALIZED for 2s [ 606.952553] env[65161]: INFO networking_nsxv3.common.synchronization [None req-9ba51caf-204a-4fe3-a653-eaff956df90c None None] Enqueued Resource ID: e6505a0b-514b-4e3d-8abb-3f19010f5d54 with Priority: HIGHEST for action port [ 606.952681] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6505a0b-514b-4e3d-8abb-3f19010f5d54 with Priority: HIGHEST for action port [ 606.953258] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6505a0b-514b-4e3d-8abb-3f19010f5d54 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.953379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6505a0b-514b-4e3d-8abb-3f19010f5d54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.953442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6505a0b-514b-4e3d-8abb-3f19010f5d54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.953688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6505a0b-514b-4e3d-8abb-3f19010f5d54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.953763] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6505a0b-514b-4e3d-8abb-3f19010f5d54',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.987284] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.987899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.987983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.988353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.988531] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.988628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.988690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.988838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.988924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.989025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.989175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.989265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.989397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.989453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.989613] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.989713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.989799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.989909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.989981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.990077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.990175] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.009136] env[65161]: INFO networking_nsxv3.common.synchronization [req-ffb00c88-1488-465f-b8c3-060e61a26047 req-99e151b3-448a-4fae-87b0-b965f9dad69e tempest-ServersAdminTestJSON-2133010713 tempest-ServersAdminTestJSON-2133010713-project-member] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 607.009136] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 607.009136] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.009136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.009136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.009136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.009136] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.009136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.009136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.010382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.010586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.010770] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.055913] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.055913] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.055913] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce already deleted. [ 607.055913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.373342] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.373342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.373342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.373342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.373342] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.373342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.373342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.373342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.373342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.373342] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.373342] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.377187] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.379667] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.379667] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.379667] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.379767] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.403556] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.403556] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.403556] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.403556] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.403556] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-cb401c34-93b0-4311-9af7-f961dacb4fa7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.403556] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-cb401c34-93b0-4311-9af7-f961dacb4fa7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.403556] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-cb401c34-93b0-4311-9af7-f961dacb4fa7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.403556] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-cb401c34-93b0-4311-9af7-f961dacb4fa7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.403556] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb401c34-93b0-4311-9af7-f961dacb4fa7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.464515] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6505a0b-514b-4e3d-8abb-3f19010f5d54 [ 607.464515] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.464747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.465163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.465447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.466199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.466676] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6505a0b-514b-4e3d-8abb-3f19010f5d54 already deleted. [ 607.466676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6505a0b-514b-4e3d-8abb-3f19010f5d54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.494293] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1dbf9f4-1099-4ece-bc31-dfb21c800cbf: rpc.has_security_group_logging(os_id): False [ 607.512913] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.512985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.513634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.513634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.513634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.514064] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.516450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.516545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.516743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.516831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.517096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.517206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.517274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.517756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.517756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.517756] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.517756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.518047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.518047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.518047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.518271] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf is going to be created. [ 607.519635] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.519737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.519803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.519953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.520044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.520246] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.520333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.520383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.520520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.520590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.520669] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 already deleted. [ 607.520745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.589882] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.590076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.590118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.590368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.590551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.606120] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf in Status: IN_PROGRESS for 2s [ 607.857555] env[65161]: INFO networking_nsxv3.common.synchronization [None req-208409e9-9c5d-407c-a17a-c696ad5b811c None None] Enqueued Resource ID: 1ab59c2d-782f-46e6-b5d6-a9a734eca233 with Priority: HIGHEST for action port [ 607.858112] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab59c2d-782f-46e6-b5d6-a9a734eca233 with Priority: HIGHEST for action port [ 607.858426] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ab59c2d-782f-46e6-b5d6-a9a734eca233 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.858629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ab59c2d-782f-46e6-b5d6-a9a734eca233" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.858629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ab59c2d-782f-46e6-b5d6-a9a734eca233" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.861893] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ab59c2d-782f-46e6-b5d6-a9a734eca233" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.861893] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ab59c2d-782f-46e6-b5d6-a9a734eca233',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.908066] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.908066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.908066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.908066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.908066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.908066] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port cb401c34-93b0-4311-9af7-f961dacb4fa7 not found, creating... [ 607.908066] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.908066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.908066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.908066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.908555] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.908555] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.908695] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.908809] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.909315] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.909936] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.909936] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: cb401c34-93b0-4311-9af7-f961dacb4fa7 is going to be created. [ 607.932347] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.932707] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.932935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.933367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.933625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.933923] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-cb401c34-93b0-4311-9af7-f961dacb4fa7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.959016] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-741 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.959016] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.959016] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.959016] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.959286] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.959400] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.959500] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.959699] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.959829] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.960305] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.960903] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.960903] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.960903] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.960903] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.960903] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.961139] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.982119] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.982119] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.982119] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.982119] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.982119] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-af7a1912-5932-4f30-9fdc-438161bdbf91 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.982119] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-af7a1912-5932-4f30-9fdc-438161bdbf91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.982481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-af7a1912-5932-4f30-9fdc-438161bdbf91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.982539] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-af7a1912-5932-4f30-9fdc-438161bdbf91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.982640] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7a1912-5932-4f30-9fdc-438161bdbf91',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.361344] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ab59c2d-782f-46e6-b5d6-a9a734eca233 [ 608.361583] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.361748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.362020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.362107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.362152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.362251] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ab59c2d-782f-46e6-b5d6-a9a734eca233 already deleted. [ 608.362888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ab59c2d-782f-46e6-b5d6-a9a734eca233" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.486309] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.487413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.487413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.487413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.487413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.487413] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port af7a1912-5932-4f30-9fdc-438161bdbf91 not found, creating... [ 608.487704] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.487893] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.488066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.488341] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.488505] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.488903] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.489096] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.489252] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.489481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.489661] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.489848] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: af7a1912-5932-4f30-9fdc-438161bdbf91 is going to be created. [ 608.513546] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.513818] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.513952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.514321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.514585] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.514833] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-af7a1912-5932-4f30-9fdc-438161bdbf91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.671448] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: SUCCESS [ 608.671740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.671942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.672160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.672937] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.672937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.672937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.672937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.672937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.672937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.672937] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.699165] env[65161]: INFO networking_nsxv3.common.synchronization [req-a73d6022-82d8-491f-a806-0d7373aaad01 req-a2bcbf7a-32eb-4b0b-ad0f-90b8a8feb187 service nova] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_rules [ 608.699343] env[65161]: INFO networking_nsxv3.common.synchronization [req-a73d6022-82d8-491f-a806-0d7373aaad01 req-a2bcbf7a-32eb-4b0b-ad0f-90b8a8feb187 service nova] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 608.699475] env[65161]: INFO networking_nsxv3.common.synchronization [req-a73d6022-82d8-491f-a806-0d7373aaad01 req-a2bcbf7a-32eb-4b0b-ad0f-90b8a8feb187 service nova] Enqueued Resource ID: cb401c34-93b0-4311-9af7-f961dacb4fa7 with Priority: HIGHEST for action port [ 608.699995] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_rules [ 608.700144] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 608.700299] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb401c34-93b0-4311-9af7-f961dacb4fa7 with Priority: HIGHEST for action port [ 608.700586] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.701219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.701302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.701588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.701684] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.703319] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.703319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.703319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.703524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.704018] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.704018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.704018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.704018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.704018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.705876] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.706506] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb401c34-93b0-4311-9af7-f961dacb4fa7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.707541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb401c34-93b0-4311-9af7-f961dacb4fa7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.707541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb401c34-93b0-4311-9af7-f961dacb4fa7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.707541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb401c34-93b0-4311-9af7-f961dacb4fa7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.707541] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb401c34-93b0-4311-9af7-f961dacb4fa7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.787054] env[65161]: INFO networking_nsxv3.common.synchronization [None req-5759a8e1-44f6-4603-aa58-b3dc0f87036c None None] Enqueued Resource ID: f98c4e21-2add-4798-bd1b-2a1aeb050d89 with Priority: HIGHEST for action port [ 608.787613] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f98c4e21-2add-4798-bd1b-2a1aeb050d89 with Priority: HIGHEST for action port [ 608.787911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f98c4e21-2add-4798-bd1b-2a1aeb050d89 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.788054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f98c4e21-2add-4798-bd1b-2a1aeb050d89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.788116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f98c4e21-2add-4798-bd1b-2a1aeb050d89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.788476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f98c4e21-2add-4798-bd1b-2a1aeb050d89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.788476] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f98c4e21-2add-4798-bd1b-2a1aeb050d89',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.176914] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.177158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.177158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.177359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.177722] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.177722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.177722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.178083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.178083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.178083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.178606] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.178606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.178606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.178606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.178841] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.178841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.178935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.179137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.179137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.179246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.179331] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.208870] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.209085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.212410] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.217724] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb401c34-93b0-4311-9af7-f961dacb4fa7 with status ACTIVE [ 609.217724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.217856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.217903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.218120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.218273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.218394] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.218497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.218559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.218709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.218782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.218984] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.219363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.219423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.219704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.219818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.219907] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb401c34-93b0-4311-9af7-f961dacb4fa7 is going to be updated. [ 609.240916] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.241082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.241169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.241361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.241499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.241694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb401c34-93b0-4311-9af7-f961dacb4fa7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.290797] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f98c4e21-2add-4798-bd1b-2a1aeb050d89 [ 609.291356] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.291356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.291356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.291505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.291534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.292360] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f98c4e21-2add-4798-bd1b-2a1aeb050d89 already deleted. [ 609.292360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f98c4e21-2add-4798-bd1b-2a1aeb050d89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.336763] env[65161]: INFO networking_nsxv3.common.synchronization [req-ffb00c88-1488-465f-b8c3-060e61a26047 req-e767a9ee-8c35-4434-9c74-3f7ca72045b4 service nova] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_rules [ 609.337073] env[65161]: INFO networking_nsxv3.common.synchronization [req-ffb00c88-1488-465f-b8c3-060e61a26047 req-e767a9ee-8c35-4434-9c74-3f7ca72045b4 service nova] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 609.337278] env[65161]: INFO networking_nsxv3.common.synchronization [req-ffb00c88-1488-465f-b8c3-060e61a26047 req-e767a9ee-8c35-4434-9c74-3f7ca72045b4 service nova] Enqueued Resource ID: af7a1912-5932-4f30-9fdc-438161bdbf91 with Priority: HIGHEST for action port [ 609.338625] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_rules [ 609.338625] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 609.338786] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af7a1912-5932-4f30-9fdc-438161bdbf91 with Priority: HIGHEST for action port [ 609.339157] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.339692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.339692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.339692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.339975] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.341876] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.342029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.342121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.342313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.343900] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.343900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.343900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.343900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.343900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.343900] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.344947] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-af7a1912-5932-4f30-9fdc-438161bdbf91 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.345093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af7a1912-5932-4f30-9fdc-438161bdbf91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.345160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af7a1912-5932-4f30-9fdc-438161bdbf91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.345453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af7a1912-5932-4f30-9fdc-438161bdbf91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.345453] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af7a1912-5932-4f30-9fdc-438161bdbf91',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.618884] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf in Status: SUCCESS [ 609.620143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.682803] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9daee2fc-9524-40ce-9dad-b50ca4273bc4: rpc.has_security_group_logging(os_id): False [ 609.703243] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.703836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.703972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.704282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.704330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.704630] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.704630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.704739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.704831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.704909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.705110] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.705206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.705287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.705440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.705515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.705692] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.705787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.705849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.706014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.706402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.706402] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 is going to be created. [ 609.721024] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.767889] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.768118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.768241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.768723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.768821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.782285] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: IN_PROGRESS for 2s [ 609.843418] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.843598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.846367] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.849470] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af7a1912-5932-4f30-9fdc-438161bdbf91 with status ACTIVE [ 609.849842] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.849842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.850020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.850152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.850216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.850477] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.850580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.850652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.853092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.853092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.853092] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.853092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.853092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.853092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.853092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.853092] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af7a1912-5932-4f30-9fdc-438161bdbf91 is going to be updated. [ 609.885891] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.886124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.886124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.886440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.886482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.886667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af7a1912-5932-4f30-9fdc-438161bdbf91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.223035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.223035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.223035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.223231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.223231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.223231] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce is going to be created. [ 610.251096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.251268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.251320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.251521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.251675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.270032] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: UNINITIALIZED for 2s [ 610.358607] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.861530] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.861998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.861998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.861998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.862249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.862249] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be created. [ 610.890816] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.890963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.891037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.891405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.891454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.904877] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: UNINITIALIZED for 2s [ 611.075871] env[65161]: INFO networking_nsxv3.common.synchronization [None req-6a85acf2-b545-46c4-aaef-02f1578ed9e0 tempest-VolumesAssistedSnapshotsTest-154839452 tempest-VolumesAssistedSnapshotsTest-154839452-project-member] Enqueued Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_rules [ 611.078396] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_rules [ 611.078396] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.078396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.078396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.078396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.078396] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.319097] env[65161]: INFO networking_nsxv3.common.synchronization [None req-f4391c50-23a2-4602-ac42-78a139e663bc tempest-VolumesAssistedSnapshotsTest-154839452 tempest-VolumesAssistedSnapshotsTest-154839452-project-member] Enqueued Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_rules [ 611.319097] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_rules [ 611.320806] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.321090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.603527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.604197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.604197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.604197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.604197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.604384] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee already deleted. [ 611.604384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.604460] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.604622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.604691] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.795525] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: SUCCESS [ 611.795816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.126468] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.126468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.126468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.126804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.126875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.127458] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee already deleted. [ 612.127458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.248150] env[65161]: INFO networking_nsxv3.common.synchronization [req-17f650c2-88ed-4fd5-9189-27ac89679fb7 req-04598fd9-3977-4571-a226-d6ecb8ab2b36 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_members [ 612.248150] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_members [ 612.248411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f835b02-6879-4c48-95a4-22113f8049b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.248713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.248901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.249277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.249566] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.249900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.250208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.250499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.250702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.250910] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.279529] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: SUCCESS [ 612.279888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.280180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.280524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.280868] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.282611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.282611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.282611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.282611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.282611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.282611] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.704820] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.705931] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.705931] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.705931] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.705931] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.705931] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.706326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.706326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.706326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.706505] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.706607] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.706713] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.706820] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.706923] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.707035] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.707161] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.727275] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.730027] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.730027] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.730027] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.730027] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-c50429ed-3101-445b-957a-8be71006780a taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.730027] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-c50429ed-3101-445b-957a-8be71006780a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.730027] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-c50429ed-3101-445b-957a-8be71006780a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.730027] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-c50429ed-3101-445b-957a-8be71006780a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.730027] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c50429ed-3101-445b-957a-8be71006780a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.756126] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.756126] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.756126] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f835b02-6879-4c48-95a4-22113f8049b5 already deleted. [ 612.756126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.787032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.787032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.787032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.787032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.787032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.787032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.787032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.787032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.787032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.787032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.787032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.787493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.787493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.787493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.787493] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.787612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.787612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.787836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.787836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.787910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.788028] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.916862] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 612.917110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.917533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.917691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.917896] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.917980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.918094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.918281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.918349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.918440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.918614] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.206525] env[65161]: INFO networking_nsxv3.common.synchronization [None req-10f90218-685d-47c3-b6b2-e181cc0dd4aa None None] Enqueued Resource ID: 7bb97cf3-0911-43b0-835e-1dc8c2c78128 with Priority: HIGHEST for action port [ 613.207152] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bb97cf3-0911-43b0-835e-1dc8c2c78128 with Priority: HIGHEST for action port [ 613.207451] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bb97cf3-0911-43b0-835e-1dc8c2c78128 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.207684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bb97cf3-0911-43b0-835e-1dc8c2c78128" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.207684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bb97cf3-0911-43b0-835e-1dc8c2c78128" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.207957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bb97cf3-0911-43b0-835e-1dc8c2c78128" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.208056] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bb97cf3-0911-43b0-835e-1dc8c2c78128',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.234159] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.235040] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.235040] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.235040] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.235040] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.235040] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port c50429ed-3101-445b-957a-8be71006780a not found, creating... [ 613.235249] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.235400] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.235509] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.235719] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.235861] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.236259] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.236422] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.236538] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.236745] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.236867] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.237028] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: c50429ed-3101-445b-957a-8be71006780a is going to be created. [ 613.257645] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.257883] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.257962] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.258398] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.258496] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.258708] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-c50429ed-3101-445b-957a-8be71006780a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.290653] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45c3c240-33f4-4e4c-b0dc-526406810cce: rpc.has_security_group_logging(os_id): False [ 613.310950] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.311174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.311174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.311441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.311530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.311732] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.311834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.311898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.312070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.312150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.312351] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.312449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.312510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.312673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.312777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.312924] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.313028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.313093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.313233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.313307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.313393] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce is going to be created. [ 613.387613] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.387613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.387822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.387875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.388099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.399125] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: IN_PROGRESS for 2s [ 613.424034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.424034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.424034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.424034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.424034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.424748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.424748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.424748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.424748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.424748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.424900] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.710393] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bb97cf3-0911-43b0-835e-1dc8c2c78128 [ 613.710393] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.710393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.710574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.710691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.710794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.710878] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bb97cf3-0911-43b0-835e-1dc8c2c78128 already deleted. [ 613.710954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bb97cf3-0911-43b0-835e-1dc8c2c78128" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.929129] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22b5f607-a69e-46b7-93e8-49d4437a6864: rpc.has_security_group_logging(os_id): False [ 613.948085] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.948085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.948085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.948085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.948085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.948085] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.948085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.948085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.948453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.948453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.948542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.948683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.948683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.949943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.949943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.949943] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.949943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.949943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.949943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.949943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.949943] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be created. [ 614.011534] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.011534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.011534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.011730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.011907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.027305] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 614.067999] env[65161]: INFO networking_nsxv3.common.synchronization [req-17f650c2-88ed-4fd5-9189-27ac89679fb7 req-b4fef8e3-3443-4fac-9144-c80bcab8cae8 service nova] Enqueued Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_rules [ 614.067999] env[65161]: INFO networking_nsxv3.common.synchronization [req-17f650c2-88ed-4fd5-9189-27ac89679fb7 req-b4fef8e3-3443-4fac-9144-c80bcab8cae8 service nova] Enqueued Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_members [ 614.067999] env[65161]: INFO networking_nsxv3.common.synchronization [req-17f650c2-88ed-4fd5-9189-27ac89679fb7 req-b4fef8e3-3443-4fac-9144-c80bcab8cae8 service nova] Enqueued Resource ID: c50429ed-3101-445b-957a-8be71006780a with Priority: HIGHEST for action port [ 614.068673] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_rules [ 614.068673] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_members [ 614.070704] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50429ed-3101-445b-957a-8be71006780a with Priority: HIGHEST for action port [ 614.070747] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f835b02-6879-4c48-95a4-22113f8049b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.071716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.071716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.071716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.071716] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.072764] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f835b02-6879-4c48-95a4-22113f8049b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.072764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.072882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.072979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.073845] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.073845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.073845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.073845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.073845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.073845] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.074627] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-c50429ed-3101-445b-957a-8be71006780a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.074737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c50429ed-3101-445b-957a-8be71006780a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.074800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c50429ed-3101-445b-957a-8be71006780a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.074950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c50429ed-3101-445b-957a-8be71006780a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.075193] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c50429ed-3101-445b-957a-8be71006780a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.576886] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.578371] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f835b02-6879-4c48-95a4-22113f8049b5 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.578371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.579611] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c50429ed-3101-445b-957a-8be71006780a with status ACTIVE [ 614.579611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.579611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.580271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.580271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.580271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.580271] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.580574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.580574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.580734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.580803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.581711] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.581711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.581711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.581711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.581868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.581868] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c50429ed-3101-445b-957a-8be71006780a is going to be updated. [ 614.593535] env[65161]: INFO networking_nsxv3.common.synchronization [req-9886d987-91f2-4cf7-9aaf-545419d37450 req-d330ae95-9d68-447a-9384-f9bc4c425b9f tempest-ServersAdminTestJSON-2133010713 tempest-ServersAdminTestJSON-2133010713-project-member] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 614.594679] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 614.595081] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.595211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.595327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.595537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.596381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.596381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.596381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.596381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.596381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.596381] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.609722] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.611032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.611032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.611032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.611032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.611032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c50429ed-3101-445b-957a-8be71006780a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.084104] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.100444] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.143255] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-741 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.143255] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.143255] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.144764] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.144764] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.144764] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.144764] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.144764] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.145108] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.145706] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.145846] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.145986] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.146121] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.146362] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.146477] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.146658] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.173199] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.174285] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.174285] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.174473] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.174625] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-714e1647-989f-407e-bbf9-be907a66f598 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.174833] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-714e1647-989f-407e-bbf9-be907a66f598" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.174971] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-714e1647-989f-407e-bbf9-be907a66f598" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.175301] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-714e1647-989f-407e-bbf9-be907a66f598" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.175439] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('714e1647-989f-407e-bbf9-be907a66f598',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.413231] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: SUCCESS [ 615.413479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.588088] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.588611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.588611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.588611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.588810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.588810] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f835b02-6879-4c48-95a4-22113f8049b5 is going to be created. [ 615.604800] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.615628] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.615831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.615877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.616155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.616321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.627440] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f835b02-6879-4c48-95a4-22113f8049b5 in Status: UNINITIALIZED for 2s [ 615.679541] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.679749] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.679829] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.680126] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.680266] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.680458] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 714e1647-989f-407e-bbf9-be907a66f598 not found, creating... [ 615.680732] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.680885] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.680996] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.681226] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.681358] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.681641] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.681823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.681936] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.682150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.682276] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.682413] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 714e1647-989f-407e-bbf9-be907a66f598 is going to be created. [ 615.706716] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.707067] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.707147] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.707592] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.707851] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.708257] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-714e1647-989f-407e-bbf9-be907a66f598" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.056017] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 616.056329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.107188] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.107352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.107862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.107862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.107862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.107862] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 616.141444] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.141444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.141444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.141444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.141444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.150740] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 616.417135] env[65161]: INFO networking_nsxv3.common.synchronization [req-9886d987-91f2-4cf7-9aaf-545419d37450 req-19811212-c08b-45f8-8aca-386e3c325c12 service nova] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_rules [ 616.417373] env[65161]: INFO networking_nsxv3.common.synchronization [req-9886d987-91f2-4cf7-9aaf-545419d37450 req-19811212-c08b-45f8-8aca-386e3c325c12 service nova] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 616.417524] env[65161]: INFO networking_nsxv3.common.synchronization [req-9886d987-91f2-4cf7-9aaf-545419d37450 req-19811212-c08b-45f8-8aca-386e3c325c12 service nova] Enqueued Resource ID: 714e1647-989f-407e-bbf9-be907a66f598 with Priority: HIGHEST for action port [ 616.418039] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_rules [ 616.418676] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 616.418676] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714e1647-989f-407e-bbf9-be907a66f598 with Priority: HIGHEST for action port [ 616.418676] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.418852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.418852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.418965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.420438] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.422166] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.422272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.422471] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-714e1647-989f-407e-bbf9-be907a66f598 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.422574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-714e1647-989f-407e-bbf9-be907a66f598" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.422650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-714e1647-989f-407e-bbf9-be907a66f598" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.423302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-714e1647-989f-407e-bbf9-be907a66f598" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.423302] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('714e1647-989f-407e-bbf9-be907a66f598',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.734651] env[65161]: INFO networking_nsxv3.common.synchronization [None req-d94323e4-8298-4c21-b6fa-0ca2b5705705 None None] Enqueued Resource ID: ec099f26-281e-4b08-8af4-f8c80977b0dc with Priority: HIGHEST for action port [ 616.735269] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec099f26-281e-4b08-8af4-f8c80977b0dc with Priority: HIGHEST for action port [ 616.736442] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec099f26-281e-4b08-8af4-f8c80977b0dc taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.736442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec099f26-281e-4b08-8af4-f8c80977b0dc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.736442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec099f26-281e-4b08-8af4-f8c80977b0dc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.736442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec099f26-281e-4b08-8af4-f8c80977b0dc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.736442] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec099f26-281e-4b08-8af4-f8c80977b0dc',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.924446] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.924693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.927841] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 714e1647-989f-407e-bbf9-be907a66f598 with status ACTIVE [ 616.928097] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.928245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.928417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.928675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.928765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.929766] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.929766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.929766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.929766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.929766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.929766] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.929766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.929766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.930099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.930099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.930099] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 714e1647-989f-407e-bbf9-be907a66f598 is going to be updated. [ 616.955930] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.955930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.955930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.955930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.955930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.955930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-714e1647-989f-407e-bbf9-be907a66f598" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.238773] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec099f26-281e-4b08-8af4-f8c80977b0dc [ 617.239818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.241025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.241025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.241025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.241025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.241025] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec099f26-281e-4b08-8af4-f8c80977b0dc already deleted. [ 617.241025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec099f26-281e-4b08-8af4-f8c80977b0dc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.639358] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f835b02-6879-4c48-95a4-22113f8049b5 in Status: SUCCESS [ 617.639594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.639780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.640221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.640221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.640413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.640413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.640587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.640688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.640773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.640865] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.789184] env[65161]: INFO networking_nsxv3.common.synchronization [None req-353b3039-8a37-43c2-87c8-4ac957ebbd04 None None] Enqueued Resource ID: b75e6ee6-35de-42cc-9c44-2517849af891 with Priority: HIGHEST for action port [ 617.789904] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b75e6ee6-35de-42cc-9c44-2517849af891 with Priority: HIGHEST for action port [ 617.790300] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b75e6ee6-35de-42cc-9c44-2517849af891 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.790454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b75e6ee6-35de-42cc-9c44-2517849af891" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.790526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b75e6ee6-35de-42cc-9c44-2517849af891" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.790776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b75e6ee6-35de-42cc-9c44-2517849af891" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.790899] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b75e6ee6-35de-42cc-9c44-2517849af891',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.143151] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.166170] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 618.166377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.166809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.167040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.167230] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.167345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.167424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.167614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.167738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.167885] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.295097] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b75e6ee6-35de-42cc-9c44-2517849af891 [ 618.295338] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.295476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.295610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.295873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.295873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.296008] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b75e6ee6-35de-42cc-9c44-2517849af891 already deleted. [ 618.296072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b75e6ee6-35de-42cc-9c44-2517849af891" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.645998] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f835b02-6879-4c48-95a4-22113f8049b5: rpc.has_security_group_logging(os_id): False [ 618.669197] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.669282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.669459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.669707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.669932] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.670079] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.670235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.670409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.670747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.670747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.670850] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f835b02-6879-4c48-95a4-22113f8049b5 is going to be created. [ 618.676599] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.739813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.740082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.740151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.740548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.740827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.755174] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f835b02-6879-4c48-95a4-22113f8049b5 in Status: IN_PROGRESS for 2s [ 619.176525] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.683034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.683034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.683034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.683034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.683034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.683034] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 619.710314] env[65161]: INFO networking_nsxv3.common.synchronization [None req-1a096d25-29e9-4ffc-8102-62d3d34df3b5 None None] Enqueued Resource ID: 1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e with Priority: HIGHEST for action port [ 619.710314] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e with Priority: HIGHEST for action port [ 619.710314] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.710314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.710314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.710857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.711078] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.716449] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.716449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.716449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.716449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.716449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.728982] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 620.214873] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e [ 620.215204] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.215552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.215552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.215635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.218306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.218306] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e already deleted. [ 620.218448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b29cc60-e5e0-4ba6-bc8a-da7915cdd64e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.266185] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2eefd9a-35cd-41c1-b238-5191244802f1 req-d68c22e5-9e76-4a81-8dcc-d53088ae6b0d tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 620.266595] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 620.267461] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.268032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.268822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.269546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.270050] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.270197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.270266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.270482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.270574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.270674] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.293554] env[65161]: INFO networking_nsxv3.common.synchronization [None req-24465c3e-8df9-4d9e-a19d-aa0b74008bf6 None None] Enqueued Resource ID: b6adcced-a2c5-4975-b454-16dc2ee4f174 with Priority: HIGHEST for action port [ 620.293935] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6adcced-a2c5-4975-b454-16dc2ee4f174 with Priority: HIGHEST for action port [ 620.294499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6adcced-a2c5-4975-b454-16dc2ee4f174 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.294637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6adcced-a2c5-4975-b454-16dc2ee4f174" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.294705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6adcced-a2c5-4975-b454-16dc2ee4f174" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.294961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6adcced-a2c5-4975-b454-16dc2ee4f174" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.295585] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6adcced-a2c5-4975-b454-16dc2ee4f174',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.729286] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.729512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.729602] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.729946] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.730224] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.730444] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.730578] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.730799] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.730936] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.731174] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.731282] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.731498] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.731629] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.731751] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.731850] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.731976] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.752613] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.752807] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.753419] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.753419] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.753419] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-37aa9787-0084-4659-99a2-d385c9ea33a0 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.753587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-37aa9787-0084-4659-99a2-d385c9ea33a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.753689] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-37aa9787-0084-4659-99a2-d385c9ea33a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.753969] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-37aa9787-0084-4659-99a2-d385c9ea33a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.754116] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37aa9787-0084-4659-99a2-d385c9ea33a0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.766835] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f835b02-6879-4c48-95a4-22113f8049b5 in Status: SUCCESS [ 620.766943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.778478] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.778642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.778715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.779787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.779849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.780155] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.780377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.780426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.780596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.780682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.780802] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b already deleted. [ 620.780901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.798516] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6adcced-a2c5-4975-b454-16dc2ee4f174 [ 620.798742] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.798880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.798942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.799170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.799258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.799350] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6adcced-a2c5-4975-b454-16dc2ee4f174 already deleted. [ 620.799440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6adcced-a2c5-4975-b454-16dc2ee4f174" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.257266] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.257266] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.257619] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.257619] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.257797] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.257907] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 37aa9787-0084-4659-99a2-d385c9ea33a0 not found, creating... [ 621.258214] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.258382] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.258495] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.258745] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.258906] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.259236] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.259401] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.259525] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.259749] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.259879] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.260042] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 37aa9787-0084-4659-99a2-d385c9ea33a0 is going to be created. [ 621.283548] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.283855] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.283855] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.284107] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.284342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.284567] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-37aa9787-0084-4659-99a2-d385c9ea33a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.743321] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 621.743321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.743321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.743321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.743321] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.743321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.743321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.744211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.744211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.744211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.744211] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.055032] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2eefd9a-35cd-41c1-b238-5191244802f1 req-b58430d4-df2b-453a-89d0-31875e87fb64 service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 622.055032] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2eefd9a-35cd-41c1-b238-5191244802f1 req-b58430d4-df2b-453a-89d0-31875e87fb64 service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 622.055032] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2eefd9a-35cd-41c1-b238-5191244802f1 req-b58430d4-df2b-453a-89d0-31875e87fb64 service nova] Enqueued Resource ID: 37aa9787-0084-4659-99a2-d385c9ea33a0 with Priority: HIGHEST for action port [ 622.056097] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 622.056173] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 622.056374] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37aa9787-0084-4659-99a2-d385c9ea33a0 with Priority: HIGHEST for action port [ 622.056692] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.056856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.056993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.057315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.057419] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.058368] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.058496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.058584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.058769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.058939] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.059759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.059759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.059759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.059759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.059759] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.060634] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-37aa9787-0084-4659-99a2-d385c9ea33a0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.060782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37aa9787-0084-4659-99a2-d385c9ea33a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.060826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37aa9787-0084-4659-99a2-d385c9ea33a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.060947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37aa9787-0084-4659-99a2-d385c9ea33a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.061034] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37aa9787-0084-4659-99a2-d385c9ea33a0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.245689] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.247145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.247145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.247145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.247145] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.247145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.247145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.247145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.248561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.248561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.248561] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.248561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.248561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.248561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.249106] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.249601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.249947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.250151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.250768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.250768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.250768] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.500838] env[65161]: INFO networking_nsxv3.common.synchronization [req-70c5305e-3bd3-459b-bfcf-611c652f7473 req-5074a967-d7f0-4401-a844-8003eb693dab tempest-ServerRescueNegativeTestJSON-1925364810 tempest-ServerRescueNegativeTestJSON-1925364810-project-member] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 622.501379] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 622.501995] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.504537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.504537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.504986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.504986] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.504986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.504986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.506096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.506096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.506096] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.563599] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.563778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.565402] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.565608] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37aa9787-0084-4659-99a2-d385c9ea33a0 with status ACTIVE [ 622.565820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.565943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.566012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.566260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.566377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.566550] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.566646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.566702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.569187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.569187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.569187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.569187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.569187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.569187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.569187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.569187] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37aa9787-0084-4659-99a2-d385c9ea33a0 is going to be updated. [ 622.595821] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.596039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.596109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.597052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.597052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.597052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37aa9787-0084-4659-99a2-d385c9ea33a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.756362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22b5f607-a69e-46b7-93e8-49d4437a6864: rpc.has_security_group_logging(os_id): False [ 622.779285] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.779493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.779493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.779723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.779882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.780049] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.780148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.780255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.780481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.780569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.780790] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.780921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.780981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.781144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.781219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.781412] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.781498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.781563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.781685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.781784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.781882] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 622.816539] env[65161]: INFO networking_nsxv3.common.synchronization [None req-181d76b0-6e64-4896-9979-fd2d7c5d7ab8 None None] Enqueued Resource ID: 32c1826e-130a-4437-bed5-30be1511935d with Priority: HIGHEST for action port [ 622.817341] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c1826e-130a-4437-bed5-30be1511935d with Priority: HIGHEST for action port [ 622.817688] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-32c1826e-130a-4437-bed5-30be1511935d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.817857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32c1826e-130a-4437-bed5-30be1511935d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.817921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32c1826e-130a-4437-bed5-30be1511935d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.818271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32c1826e-130a-4437-bed5-30be1511935d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.818449] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32c1826e-130a-4437-bed5-30be1511935d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.853760] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.853760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.853760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.853760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.853760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.865137] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 623.008024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.009023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.009023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.009023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.009023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.009023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.009023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.009023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.009337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.009337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.009337] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d already deleted. [ 623.009337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.070016] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.172584] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-179 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.172980] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.172980] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.173753] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.174295] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.174388] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.174498] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.174761] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.174918] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.175233] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.175328] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.175454] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.175564] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.175673] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.175774] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.175899] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.196356] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.196530] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.196697] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.196806] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.197259] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-55a6b483-ccef-4452-b85e-34ffc7dd6fef taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.197454] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-55a6b483-ccef-4452-b85e-34ffc7dd6fef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.197574] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-55a6b483-ccef-4452-b85e-34ffc7dd6fef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.197905] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-55a6b483-ccef-4452-b85e-34ffc7dd6fef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.198067] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55a6b483-ccef-4452-b85e-34ffc7dd6fef',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.320836] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32c1826e-130a-4437-bed5-30be1511935d [ 623.321539] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.321539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.321779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.321811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.321905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.321997] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32c1826e-130a-4437-bed5-30be1511935d already deleted. [ 623.322103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32c1826e-130a-4437-bed5-30be1511935d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.409750] env[65161]: INFO networking_nsxv3.common.synchronization [None req-d5fb049d-6d45-41ab-a312-abd60ff25838 None None] Enqueued Resource ID: 3e0878e7-a1d6-45de-88ba-81de7dcb722a with Priority: HIGHEST for action port [ 623.409750] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e0878e7-a1d6-45de-88ba-81de7dcb722a with Priority: HIGHEST for action port [ 623.413025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e0878e7-a1d6-45de-88ba-81de7dcb722a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.413025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e0878e7-a1d6-45de-88ba-81de7dcb722a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.413025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e0878e7-a1d6-45de-88ba-81de7dcb722a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.413025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e0878e7-a1d6-45de-88ba-81de7dcb722a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.413025] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e0878e7-a1d6-45de-88ba-81de7dcb722a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.573491] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.573838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.573838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.573936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.574088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.574134] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be created. [ 623.598860] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.599503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.599503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.599666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.599946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.610960] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: UNINITIALIZED for 2s [ 623.700263] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.700525] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.700691] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.701098] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.701098] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.701214] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 55a6b483-ccef-4452-b85e-34ffc7dd6fef not found, creating... [ 623.701477] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.701656] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.701772] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.701982] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.702126] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.702393] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.702541] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.702652] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.702849] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.702973] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.706141] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 55a6b483-ccef-4452-b85e-34ffc7dd6fef is going to be created. [ 623.727652] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.727652] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.727652] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.727652] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.727652] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.727652] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-55a6b483-ccef-4452-b85e-34ffc7dd6fef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.913157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e0878e7-a1d6-45de-88ba-81de7dcb722a [ 623.913381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.913518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.913586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.913802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.913879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.913970] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e0878e7-a1d6-45de-88ba-81de7dcb722a already deleted. [ 623.914062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e0878e7-a1d6-45de-88ba-81de7dcb722a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.433571] env[65161]: INFO networking_nsxv3.common.synchronization [req-70c5305e-3bd3-459b-bfcf-611c652f7473 req-611c74f0-9f5d-464a-b701-94a239327186 service nova] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_rules [ 624.433656] env[65161]: INFO networking_nsxv3.common.synchronization [req-70c5305e-3bd3-459b-bfcf-611c652f7473 req-611c74f0-9f5d-464a-b701-94a239327186 service nova] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 624.433774] env[65161]: INFO networking_nsxv3.common.synchronization [req-70c5305e-3bd3-459b-bfcf-611c652f7473 req-611c74f0-9f5d-464a-b701-94a239327186 service nova] Enqueued Resource ID: 55a6b483-ccef-4452-b85e-34ffc7dd6fef with Priority: HIGHEST for action port [ 624.434340] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_rules [ 624.434481] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 624.435120] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a6b483-ccef-4452-b85e-34ffc7dd6fef with Priority: HIGHEST for action port [ 624.435420] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.435561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.435721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.435877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.435964] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.437895] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.438048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.438117] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.438325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.438618] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.438726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.438788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.438956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.439045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.439160] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.440722] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-55a6b483-ccef-4452-b85e-34ffc7dd6fef taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.440790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55a6b483-ccef-4452-b85e-34ffc7dd6fef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.440851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55a6b483-ccef-4452-b85e-34ffc7dd6fef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.441054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55a6b483-ccef-4452-b85e-34ffc7dd6fef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.441245] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55a6b483-ccef-4452-b85e-34ffc7dd6fef',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.888362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 624.888362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.905812] env[65161]: INFO networking_nsxv3.common.synchronization [req-29c57fbc-fe4f-4ee9-aa65-92e92f0b7931 req-607ca426-e07b-4b11-93b6-d2e518f7b589 tempest-VolumesAssistedSnapshotsTest-154839452 tempest-VolumesAssistedSnapshotsTest-154839452-project-member] Enqueued Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_members [ 624.906804] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_members [ 624.906804] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-3151ee71-d6fa-4cda-bd22-0038b5e588ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.906981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.906981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.909814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.909999] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.910132] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.910195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.910367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.910519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.910623] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.938670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.938951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.942248] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.943599] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55a6b483-ccef-4452-b85e-34ffc7dd6fef with status ACTIVE [ 624.943807] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.943948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.944428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.944428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.944428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.944654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.944654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.944654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.944889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.944889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.945025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.947074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.947151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.947991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.947991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.947991] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55a6b483-ccef-4452-b85e-34ffc7dd6fef is going to be updated. [ 624.979761] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.979761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.979761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.979761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.979761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.979761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55a6b483-ccef-4452-b85e-34ffc7dd6fef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.318035] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.319430] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-656" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.319430] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-656" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.319430] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-656" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.319927] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.320092] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.320209] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.321069] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.321361] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.321709] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.321822] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.321977] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.324646] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.324646] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.324646] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.324646] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.350736] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.351319] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.351787] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.351787] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-656" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.351912] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-1bac6fac-dd90-4398-a386-7eb6479cd06a taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.352327] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-1bac6fac-dd90-4398-a386-7eb6479cd06a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.352327] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-1bac6fac-dd90-4398-a386-7eb6479cd06a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.352895] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-1bac6fac-dd90-4398-a386-7eb6479cd06a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.352895] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bac6fac-dd90-4398-a386-7eb6479cd06a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.412898] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.413137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.413216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.413474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.413583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.413827] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.413935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.413995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.414225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.414306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.414375] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee already deleted. [ 625.414456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.451039] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.622977] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 625.623143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.623317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.623540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.623728] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.624189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.624189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.624189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.624189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.624361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.624361] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.736543] env[65161]: INFO networking_nsxv3.common.synchronization [None req-02584654-a265-43ae-975b-4dad00830258 None None] Enqueued Resource ID: 4961d6bd-9f84-484a-8ebc-8b5830270a43 with Priority: HIGHEST for action port [ 625.737604] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4961d6bd-9f84-484a-8ebc-8b5830270a43 with Priority: HIGHEST for action port [ 625.738131] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-4961d6bd-9f84-484a-8ebc-8b5830270a43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.738284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4961d6bd-9f84-484a-8ebc-8b5830270a43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.738465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4961d6bd-9f84-484a-8ebc-8b5830270a43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.738772] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4961d6bd-9f84-484a-8ebc-8b5830270a43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.738906] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4961d6bd-9f84-484a-8ebc-8b5830270a43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.859037] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.859372] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.859554] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.859962] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.860150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.860372] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 1bac6fac-dd90-4398-a386-7eb6479cd06a not found, creating... [ 625.860747] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.860988] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.861442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.861442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.861620] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.861998] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.862219] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.862392] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.862650] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.863333] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.863333] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 1bac6fac-dd90-4398-a386-7eb6479cd06a is going to be created. [ 625.889024] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.889024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.889024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.889024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.889024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.890032] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-1bac6fac-dd90-4398-a386-7eb6479cd06a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.953813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.955235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.955235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.955235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.955235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.955235] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d is going to be created. [ 626.001135] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.001327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.001386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.001704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.002443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.024775] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: UNINITIALIZED for 2s [ 626.128067] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.128643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.128643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.128643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.128771] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.128875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.128938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.129118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.129210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.129301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.129445] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.129540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.129621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.129741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.129881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.129966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.130027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.130171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.130246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.130329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.130462] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.150500] env[65161]: INFO networking_nsxv3.common.synchronization [req-8ea8e058-ec9b-4423-866a-df0f422b8e14 req-8b63e950-3044-4401-ae4d-b4811603b68b tempest-SecurityGroupRulesNegativeTestJSON-924814060 tempest-SecurityGroupRulesNegativeTestJSON-924814060-project-member] Enqueued Resource ID: 2399ffce-7716-46d2-84ce-7bc9083e9c6f with Priority: HIGHEST for action security_group_rules [ 626.151374] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2399ffce-7716-46d2-84ce-7bc9083e9c6f with Priority: HIGHEST for action security_group_rules [ 626.151374] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.151608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.151608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.151946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.151946] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2399ffce-7716-46d2-84ce-7bc9083e9c6f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.241709] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4961d6bd-9f84-484a-8ebc-8b5830270a43 [ 626.243168] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.243168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.243168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.243168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.243168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.243622] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4961d6bd-9f84-484a-8ebc-8b5830270a43 already deleted. [ 626.243844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4961d6bd-9f84-484a-8ebc-8b5830270a43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.591930] env[65161]: INFO networking_nsxv3.common.synchronization [req-29c57fbc-fe4f-4ee9-aa65-92e92f0b7931 req-82748ac4-5c11-4c32-8daa-8bc848a02e27 service nova] Enqueued Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_rules [ 626.592535] env[65161]: INFO networking_nsxv3.common.synchronization [req-29c57fbc-fe4f-4ee9-aa65-92e92f0b7931 req-82748ac4-5c11-4c32-8daa-8bc848a02e27 service nova] Enqueued Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_members [ 626.592535] env[65161]: INFO networking_nsxv3.common.synchronization [req-29c57fbc-fe4f-4ee9-aa65-92e92f0b7931 req-82748ac4-5c11-4c32-8daa-8bc848a02e27 service nova] Enqueued Resource ID: 1bac6fac-dd90-4398-a386-7eb6479cd06a with Priority: HIGHEST for action port [ 626.593050] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_rules [ 626.593222] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_members [ 626.593352] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bac6fac-dd90-4398-a386-7eb6479cd06a with Priority: HIGHEST for action port [ 626.593868] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.593868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.593868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.594168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.594202] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.595560] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-3151ee71-d6fa-4cda-bd22-0038b5e588ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.595703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.595789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.596094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.596230] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.596343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.596693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.596693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.596693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.596868] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.597576] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bac6fac-dd90-4398-a386-7eb6479cd06a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.597689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bac6fac-dd90-4398-a386-7eb6479cd06a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.597759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bac6fac-dd90-4398-a386-7eb6479cd06a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.597909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bac6fac-dd90-4398-a386-7eb6479cd06a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.597978] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bac6fac-dd90-4398-a386-7eb6479cd06a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.633926] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68ff1a7f-59cd-4081-9af0-9322734ba92b: rpc.has_security_group_logging(os_id): False [ 626.654030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.654030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.654030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.654237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.654237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.654401] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.654514] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.654579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.654735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.654815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.655030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.655146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.655211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.655354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.655459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.655731] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.655845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.655937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.656186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.656296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.656421] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be created. [ 626.683119] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.683397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.683474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.683728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.683822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.683923] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2399ffce-7716-46d2-84ce-7bc9083e9c6f already deleted. [ 626.684011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.722914] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.723085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.723133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.723347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.723529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.734473] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 627.099582] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-3151ee71-d6fa-4cda-bd22-0038b5e588ee taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.099955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.099995] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.101022] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bac6fac-dd90-4398-a386-7eb6479cd06a with status ACTIVE [ 627.101257] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.101936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.101936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.101936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.101936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.102256] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.102256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.102345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.102663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.102663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.102752] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.102811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.102884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.103088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.103171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.103724] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bac6fac-dd90-4398-a386-7eb6479cd06a is going to be updated. [ 627.127547] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.127757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.127813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.128019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.128224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.128560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bac6fac-dd90-4398-a386-7eb6479cd06a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.606620] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.945947] env[65161]: INFO networking_nsxv3.common.synchronization [None req-474b58d0-775e-48cf-be18-6d4605451cf2 tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 627.946191] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 627.946571] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.946699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.946742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.947058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.947125] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.038309] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: SUCCESS [ 628.038591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.038994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.039110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.039389] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.039477] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.039477] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.040119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.040119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.040119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.040119] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.089700] env[65161]: INFO networking_nsxv3.common.synchronization [req-09d45a90-288d-4072-8c0c-fab143fc6f78 req-d3d616e1-a935-4691-ae1c-0405a60ea3a9 tempest-ImagesNegativeTestJSON-536901030 tempest-ImagesNegativeTestJSON-536901030-project-member] Enqueued Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGHEST for action security_group_members [ 628.090663] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGHEST for action security_group_members [ 628.090852] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd743095-5c04-42e0-a757-109988198d4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.090981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.091064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.091324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.091498] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.091611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.091675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.091832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.091984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.092045] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.109794] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.110177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.110177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.110291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.110379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.110566] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee is going to be created. [ 628.139989] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.140205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.140265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.140678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.141297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.151919] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee in Status: UNINITIALIZED for 2s [ 628.237727] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c66d26f2-54b1-4baf-ae6b-40fa76c39e3b tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 628.238294] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 628.239577] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.239647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.471624] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.471802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.471842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.472144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.472256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.472351] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 already deleted. [ 628.472441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.472592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.472921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.472921] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.544060] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.544060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.544060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.544060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.544060] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.544060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.544060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.544870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.544984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.545723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.545723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.545723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.545723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.545723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.545956] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.545956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.547599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.547599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.547599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.547599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.547599] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.594654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.594863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.594947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.595209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.595305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.595501] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.595621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.595710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.595899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.595992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.596114] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd743095-5c04-42e0-a757-109988198d4e already deleted. [ 628.596269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.602590] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-399 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.602777] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-399" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.602894] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-399" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.603214] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-399" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.603471] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.603639] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.603734] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.603941] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.604086] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.604286] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.604394] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.604496] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.604598] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.604699] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.604795] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.604935] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.623952] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.623952] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.623952] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.623952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-399" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.624166] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-05949f03-60b5-4b77-b302-8ddc48ad95a4 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.624331] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-05949f03-60b5-4b77-b302-8ddc48ad95a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.624442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-05949f03-60b5-4b77-b302-8ddc48ad95a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.624787] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-05949f03-60b5-4b77-b302-8ddc48ad95a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.624918] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05949f03-60b5-4b77-b302-8ddc48ad95a4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.746208] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 628.746533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.995779] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.995955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.996030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.996232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.996323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.996416] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 already deleted. [ 628.996500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.050418] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48e5829e-83e0-44d7-b9e9-c3210ec30d0d: rpc.has_security_group_logging(os_id): False [ 629.068954] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.069239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.069239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.069416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.069509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.069783] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.069886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.069928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.070391] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.070391] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.070391] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.070585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.070585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.070884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.070884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.071074] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.071074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.071191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.071303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.071384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.071477] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d is going to be created. [ 629.129590] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.129965] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.130063] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.130503] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.130860] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.131994] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 05949f03-60b5-4b77-b302-8ddc48ad95a4 not found, creating... [ 629.131994] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.131994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.131994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.131994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.132357] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.132565] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.132803] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.132963] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.133224] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.133376] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.134424] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 05949f03-60b5-4b77-b302-8ddc48ad95a4 is going to be created. [ 629.137216] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.137375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.137437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.137638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.137823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.158777] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: IN_PROGRESS for 2s [ 629.163859] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.164028] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.164176] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.164460] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.164737] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.165156] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-05949f03-60b5-4b77-b302-8ddc48ad95a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.895399] env[65161]: INFO networking_nsxv3.common.synchronization [req-09d45a90-288d-4072-8c0c-fab143fc6f78 req-a77b32c1-3246-4348-ae82-aadc7f6b4039 service nova] Enqueued Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGHEST for action security_group_rules [ 629.895516] env[65161]: INFO networking_nsxv3.common.synchronization [req-09d45a90-288d-4072-8c0c-fab143fc6f78 req-a77b32c1-3246-4348-ae82-aadc7f6b4039 service nova] Enqueued Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGHEST for action security_group_members [ 629.895629] env[65161]: INFO networking_nsxv3.common.synchronization [req-09d45a90-288d-4072-8c0c-fab143fc6f78 req-a77b32c1-3246-4348-ae82-aadc7f6b4039 service nova] Enqueued Resource ID: 05949f03-60b5-4b77-b302-8ddc48ad95a4 with Priority: HIGHEST for action port [ 629.896160] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGHEST for action security_group_rules [ 629.896296] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGHEST for action security_group_members [ 629.896391] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05949f03-60b5-4b77-b302-8ddc48ad95a4 with Priority: HIGHEST for action port [ 629.896659] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd743095-5c04-42e0-a757-109988198d4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.896782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.896844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.897111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.897193] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.898055] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd743095-5c04-42e0-a757-109988198d4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.898176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.898241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.898636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.898636] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.898807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.898807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.898910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.898960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.899039] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.899852] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-05949f03-60b5-4b77-b302-8ddc48ad95a4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.899967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05949f03-60b5-4b77-b302-8ddc48ad95a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.899967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05949f03-60b5-4b77-b302-8ddc48ad95a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.900133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05949f03-60b5-4b77-b302-8ddc48ad95a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.900202] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05949f03-60b5-4b77-b302-8ddc48ad95a4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.166223] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee in Status: SUCCESS [ 630.166556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.166617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.166805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.166999] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.167153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.167216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.167442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.167442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.167581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.167581] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.402554] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd743095-5c04-42e0-a757-109988198d4e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.402554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.404046] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.405284] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05949f03-60b5-4b77-b302-8ddc48ad95a4 with status ACTIVE [ 630.406746] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.406746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.406746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.406746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.406746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.406746] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.406746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.406746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.406746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.406746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.407233] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.407233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.409296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.411653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.412234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.412234] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05949f03-60b5-4b77-b302-8ddc48ad95a4 is going to be updated. [ 630.437965] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.438216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.438327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.438745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.438980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.439770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05949f03-60b5-4b77-b302-8ddc48ad95a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.664099] env[65161]: INFO networking_nsxv3.common.synchronization [req-f60f38b0-ed72-47e0-ba52-e747e01f1b38 req-a3e6e352-e5b5-421a-bfb4-578341aa344d tempest-DeleteServersAdminTestJSON-145731236 tempest-DeleteServersAdminTestJSON-145731236-project-admin] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 630.665092] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 630.665824] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.666015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.666093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.666362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.666585] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.666747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.666840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.667111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.667352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.667352] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.670331] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.802720] env[65161]: INFO networking_nsxv3.common.synchronization [req-08920a78-d040-4703-a0ad-7a9b2b74cb4c req-1898551e-f3d2-4d17-9bec-2b080d6dde11 tempest-ServerRescueNegativeTestJSON-1925364810 tempest-ServerRescueNegativeTestJSON-1925364810-project-member] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 630.803369] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 630.803716] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.803871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.803966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.804212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.804399] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.804550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.804643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.804835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.804949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.805109] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.916224] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.170849] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.171228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.171228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.171970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.171970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.172117] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.172222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.172309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.172606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.172742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.172997] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 is going to be updated. [ 631.175442] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3151ee71-d6fa-4cda-bd22-0038b5e588ee: rpc.has_security_group_logging(os_id): False [ 631.178157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: SUCCESS [ 631.178403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.204873] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.205438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.205650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.206085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.206331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.207296] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.207296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.207296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.207516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.207730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.208016] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee is going to be created. [ 631.211242] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.211242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.211242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.211605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.212185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.223053] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: IN_PROGRESS for 2s [ 631.289767] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.290032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.290120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.290420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.290698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.305604] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee in Status: IN_PROGRESS for 2s [ 631.307089] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.335793] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-179 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.335980] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.336104] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.336383] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.336660] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.336848] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.336929] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.337218] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.337408] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.337557] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.338218] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.338385] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.338505] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.338752] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.338752] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.338888] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.391428] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.391823] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.053 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.391913] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.392124] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.392705] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.392952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.393108] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.393729] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.393871] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('080e2967-c4ff-4ee9-a583-d3e378e3a1fb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.418601] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.418857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.418956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.419160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.419255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.419356] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd743095-5c04-42e0-a757-109988198d4e is going to be created. [ 631.452102] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.452330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.452406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.452666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.452903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.468751] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd743095-5c04-42e0-a757-109988198d4e in Status: UNINITIALIZED for 2s [ 631.494126] env[65161]: INFO networking_nsxv3.common.synchronization [req-8a6a8cc5-a9c2-4080-ad88-53c4dad4e021 req-1ebdb3af-d092-40c2-ae66-afca22fb6411 tempest-SecurityGroupRulesNegativeTestJSON-924814060 tempest-SecurityGroupRulesNegativeTestJSON-924814060-project-member] Enqueued Resource ID: 2399ffce-7716-46d2-84ce-7bc9083e9c6f with Priority: HIGHEST for action security_group_rules [ 631.496270] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2399ffce-7716-46d2-84ce-7bc9083e9c6f with Priority: HIGHEST for action security_group_rules [ 631.496270] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.496270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.496270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.496270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.496270] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2399ffce-7716-46d2-84ce-7bc9083e9c6f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.810301] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.897588] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.897921] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.898138] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.898601] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.898807] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.898964] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 080e2967-c4ff-4ee9-a583-d3e378e3a1fb not found, creating... [ 631.899262] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.899440] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.899850] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.900129] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.900286] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.900836] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.901022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.901140] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.901516] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.901665] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.901806] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 080e2967-c4ff-4ee9-a583-d3e378e3a1fb is going to be created. [ 631.931351] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.931630] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.931828] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.932167] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.932409] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.932676] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.023593] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.023593] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.023714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.023882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.024042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.024144] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2399ffce-7716-46d2-84ce-7bc9083e9c6f already deleted. [ 632.024232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2399ffce-7716-46d2-84ce-7bc9083e9c6f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.314254] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.314722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.314722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.314722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.314845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.314904] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d is going to be updated. [ 632.372866] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.372866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.372866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.372866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.373115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.392029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: IN_PROGRESS for 2s [ 632.393687] env[65161]: INFO networking_nsxv3.common.synchronization [req-42559c9e-3465-4f84-88d2-e5e70d61d06d req-75bc9abc-7112-44d9-8b31-b0d27b356de5 tempest-AttachInterfacesV270Test-554144948 tempest-AttachInterfacesV270Test-554144948-project-member] Enqueued Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGHEST for action security_group_members [ 632.397111] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGHEST for action security_group_members [ 632.397473] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.397608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.397690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.397900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.398351] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.398351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.398351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.398351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.398552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.398552] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.646752] env[65161]: INFO networking_nsxv3.common.synchronization [req-08920a78-d040-4703-a0ad-7a9b2b74cb4c req-93d2ab94-cb61-47af-b1b3-4a15dc26fbee service nova] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_rules [ 632.646931] env[65161]: INFO networking_nsxv3.common.synchronization [req-08920a78-d040-4703-a0ad-7a9b2b74cb4c req-93d2ab94-cb61-47af-b1b3-4a15dc26fbee service nova] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 632.647075] env[65161]: INFO networking_nsxv3.common.synchronization [req-08920a78-d040-4703-a0ad-7a9b2b74cb4c req-93d2ab94-cb61-47af-b1b3-4a15dc26fbee service nova] Enqueued Resource ID: 080e2967-c4ff-4ee9-a583-d3e378e3a1fb with Priority: HIGHEST for action port [ 632.647562] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_rules [ 632.647699] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 632.647794] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 080e2967-c4ff-4ee9-a583-d3e378e3a1fb with Priority: HIGHEST for action port [ 632.648228] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.648375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.648444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.648676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.649139] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.650785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.650954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.651166] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.651237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.651322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.651501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.651543] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('080e2967-c4ff-4ee9-a583-d3e378e3a1fb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.900707] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.901295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.902057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.902057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.902057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.902309] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.902309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.902309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.902460] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.902543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.902830] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf is going to be updated. [ 632.933875] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.933875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.933875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.934398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.934398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.944045] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf in Status: IN_PROGRESS for 2s [ 633.059778] env[65161]: INFO networking_nsxv3.common.synchronization [req-71ebd17f-622d-4d24-8bc3-50eb874f8df9 req-bfdf0b3a-d1a4-4a1d-ac92-9eb34af4c368 tempest-ImagesOneServerTestJSON-1053652074 tempest-ImagesOneServerTestJSON-1053652074-project-member] Enqueued Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGHEST for action security_group_members [ 633.060944] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGHEST for action security_group_members [ 633.061427] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb265379-c4fb-47cf-afb5-2c655df91dbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.061427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.061569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.061778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.061937] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.062046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.062107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.062268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.062357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.062591] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.151069] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.151250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.153872] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 080e2967-c4ff-4ee9-a583-d3e378e3a1fb with status ACTIVE [ 633.154205] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.154537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.154682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.154939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.155080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.155299] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.155430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.155513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.155721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.155805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.156190] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.156190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.156349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.156628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.156699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.157181] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 080e2967-c4ff-4ee9-a583-d3e378e3a1fb is going to be updated. [ 633.185596] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.185894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.186041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.186663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.186829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.188073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-080e2967-c4ff-4ee9-a583-d3e378e3a1fb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.233378] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: IN_PROGRESS for 4s [ 633.335407] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee in Status: SUCCESS [ 633.335894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.482029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd743095-5c04-42e0-a757-109988198d4e in Status: SUCCESS [ 633.482029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.482029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.482029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.482029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.482029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.482029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.482289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.482289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.483208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.483453] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.538240] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.538488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-167" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.538700] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-167" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.539223] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-167" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.539649] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.540040] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.540128] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.540576] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.540746] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.541072] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.541254] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.541419] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.541587] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.541745] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.541906] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.542110] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.566236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.566410] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.566564] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.566815] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-167" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.567421] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-265d8ea1-484a-4434-9631-513e8e9f784b taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.567716] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-265d8ea1-484a-4434-9631-513e8e9f784b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.567987] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-265d8ea1-484a-4434-9631-513e8e9f784b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.569194] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-265d8ea1-484a-4434-9631-513e8e9f784b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.569194] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('265d8ea1-484a-4434-9631-513e8e9f784b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.569496] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.569614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.572911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.572911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.572911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.572911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.572911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.572911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.572911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.572911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.572911] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb265379-c4fb-47cf-afb5-2c655df91dbf already deleted. [ 633.572911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.986356] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd743095-5c04-42e0-a757-109988198d4e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.986509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.986623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.986822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.987011] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.987119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.987196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.987351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.987454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.987743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.987743] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd743095-5c04-42e0-a757-109988198d4e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.987916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.987916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.988092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.988251] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.988362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.988422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.988579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.988857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.988857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.988857] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.072716] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.073168] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.073297] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.073589] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.073739] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.073944] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 265d8ea1-484a-4434-9631-513e8e9f784b not found, creating... [ 634.074177] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.074356] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.074447] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.074666] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.074798] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.075100] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.075297] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.075366] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.075593] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.075681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.075812] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 265d8ea1-484a-4434-9631-513e8e9f784b is going to be created. [ 634.097705] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.097884] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.098008] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.098289] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.098551] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.099223] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-265d8ea1-484a-4434-9631-513e8e9f784b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.402208] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: SUCCESS [ 634.402578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.402637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.403082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.403082] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.403192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.403229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.403374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.403457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.403555] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.491566] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd743095-5c04-42e0-a757-109988198d4e: rpc.has_security_group_logging(os_id): False [ 634.509256] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.509538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.509682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.509974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.510088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.510313] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.510412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.510474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.510694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.510781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.510953] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.511054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.511185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.511254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.511320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.511497] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.511604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.511667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.511807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.511883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.511966] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd743095-5c04-42e0-a757-109988198d4e is going to be created. [ 634.584267] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.584267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.584267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.584267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.584267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.597016] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd743095-5c04-42e0-a757-109988198d4e in Status: IN_PROGRESS for 2s [ 634.843353] env[65161]: INFO networking_nsxv3.common.synchronization [req-71ebd17f-622d-4d24-8bc3-50eb874f8df9 req-d53da8e9-d59e-4f9a-9205-e4481882dfd8 service nova] Enqueued Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGHEST for action security_group_rules [ 634.843353] env[65161]: INFO networking_nsxv3.common.synchronization [req-71ebd17f-622d-4d24-8bc3-50eb874f8df9 req-d53da8e9-d59e-4f9a-9205-e4481882dfd8 service nova] Enqueued Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGHEST for action security_group_members [ 634.843353] env[65161]: INFO networking_nsxv3.common.synchronization [req-71ebd17f-622d-4d24-8bc3-50eb874f8df9 req-d53da8e9-d59e-4f9a-9205-e4481882dfd8 service nova] Enqueued Resource ID: 265d8ea1-484a-4434-9631-513e8e9f784b with Priority: HIGHEST for action port [ 634.843353] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGHEST for action security_group_rules [ 634.843512] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGHEST for action security_group_members [ 634.843560] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 265d8ea1-484a-4434-9631-513e8e9f784b with Priority: HIGHEST for action port [ 634.843919] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb265379-c4fb-47cf-afb5-2c655df91dbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.844074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.844310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.844346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.844440] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.845667] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb265379-c4fb-47cf-afb5-2c655df91dbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.845667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.845667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.845904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.845904] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.847047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.847047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.847047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.847047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.847047] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.849751] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-265d8ea1-484a-4434-9631-513e8e9f784b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.849751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-265d8ea1-484a-4434-9631-513e8e9f784b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.849751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-265d8ea1-484a-4434-9631-513e8e9f784b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.849751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-265d8ea1-484a-4434-9631-513e8e9f784b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.850512] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('265d8ea1-484a-4434-9631-513e8e9f784b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.906736] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.957948] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf in Status: SUCCESS [ 634.958138] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf deletion is rescheduled due to dependency. [ 634.958318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.248216] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: SUCCESS [ 635.248403] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 deletion is rescheduled due to dependency. [ 635.248520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.350376] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.351533] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb265379-c4fb-47cf-afb5-2c655df91dbf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.351728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.354161] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 265d8ea1-484a-4434-9631-513e8e9f784b with status ACTIVE [ 635.354383] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.354518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.354589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.354809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.354899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.355369] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.355369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.355369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.355605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.355605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.355697] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.355802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.355865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.356039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.356102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.356187] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 265d8ea1-484a-4434-9631-513e8e9f784b is going to be updated. [ 635.386046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.386259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.386780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.386780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.387205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.387463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-265d8ea1-484a-4434-9631-513e8e9f784b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.409335] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.856037] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.913643] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.913978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.914146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.914432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.914607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.914779] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d is going to be updated. [ 635.948818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.948959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.951156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.951156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.951156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.960216] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: IN_PROGRESS for 2s [ 636.358558] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.359724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.361963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.361963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.361963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.361963] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb265379-c4fb-47cf-afb5-2c655df91dbf is going to be created. [ 636.390074] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.390809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.390809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.391071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.391356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.403231] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb265379-c4fb-47cf-afb5-2c655df91dbf in Status: UNINITIALIZED for 2s [ 636.610649] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd743095-5c04-42e0-a757-109988198d4e in Status: SUCCESS [ 636.610649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.612761] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c8c85634-5718-4f2a-871d-0cb03b26f957 None None] Enqueued Resource ID: a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4 with Priority: HIGHEST for action port [ 636.613405] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4 with Priority: HIGHEST for action port [ 636.613877] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.613877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.613877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.614234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.614310] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.117599] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4 [ 637.117599] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.117599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.117599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.117599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.117599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.117599] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4 already deleted. [ 637.117599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a33fa22b-0ad6-4f0d-8fd7-7021125a0fa4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.319666] env[65161]: INFO networking_nsxv3.common.synchronization [req-bbc0753e-e080-415d-94fb-04737ad683b5 req-185b2ec9-7ea9-4796-bf68-d5b386b24fbf tempest-ServerDiagnosticsNegativeTest-296237889 tempest-ServerDiagnosticsNegativeTest-296237889-project-member] Enqueued Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGHEST for action security_group_members [ 637.320212] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGHEST for action security_group_members [ 637.320524] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.320706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.320792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.321135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.321261] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.321363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.321427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.321588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.321681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.322072] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.824470] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.824900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.824900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.824900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.825045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.827383] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.827383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.827383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.827383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.827383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.827383] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d already deleted. [ 637.827383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.970338] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: SUCCESS [ 637.970338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.970641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.970919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.971498] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.971498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.971498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.971498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.971796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.971796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.971796] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.186208] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.186447] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.186567] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.186841] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.190019] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.190019] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.190019] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.190019] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.190019] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.190019] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.190019] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.190019] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.190019] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.190019] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.190019] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.190019] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.210897] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.211060] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.211197] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.211359] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.211721] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-539860a2-c4aa-4b65-84d0-f5ca958177e6 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.211894] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-539860a2-c4aa-4b65-84d0-f5ca958177e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.213604] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-539860a2-c4aa-4b65-84d0-f5ca958177e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.213604] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-539860a2-c4aa-4b65-84d0-f5ca958177e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.213604] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('539860a2-c4aa-4b65-84d0-f5ca958177e6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.413095] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb265379-c4fb-47cf-afb5-2c655df91dbf in Status: SUCCESS [ 638.413581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.413695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.413909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.414175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.414315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.414376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.414567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.414721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.414782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.414832] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.476015] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.476283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.476374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.476587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.476854] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.476967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.477050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.477224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.477337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.477441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.477611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.477694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.477781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.477913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.478070] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.478196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.478260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.478450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.478543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.478627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.478719] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.715843] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.716013] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.717044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.717044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.717044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.717044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 539860a2-c4aa-4b65-84d0-f5ca958177e6 not found, creating... [ 638.717044] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.717368] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.717368] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.717489] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.717621] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.717891] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.718051] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.718164] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.718364] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.718490] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.718727] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 539860a2-c4aa-4b65-84d0-f5ca958177e6 is going to be created. [ 638.741559] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.741817] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.741942] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.742233] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.742454] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.742675] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-539860a2-c4aa-4b65-84d0-f5ca958177e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.764728] env[65161]: INFO networking_nsxv3.common.synchronization [None req-6635dc47-fe98-4880-b345-a12298f9935f None None] Enqueued Resource ID: 777e1cfe-d182-4171-a4f1-ea762602249c with Priority: HIGHEST for action port [ 638.765305] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777e1cfe-d182-4171-a4f1-ea762602249c with Priority: HIGHEST for action port [ 638.765617] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-777e1cfe-d182-4171-a4f1-ea762602249c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.765768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-777e1cfe-d182-4171-a4f1-ea762602249c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.765835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-777e1cfe-d182-4171-a4f1-ea762602249c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.766288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-777e1cfe-d182-4171-a4f1-ea762602249c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.766466] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('777e1cfe-d182-4171-a4f1-ea762602249c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.917817] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb265379-c4fb-47cf-afb5-2c655df91dbf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.918217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.918217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.918599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.918958] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.919125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.919186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.919320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.919417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.919508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.919662] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb265379-c4fb-47cf-afb5-2c655df91dbf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.919757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.919817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.919962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.920113] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.920208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.920276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.920415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.920491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.920573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.920681] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.967358] env[65161]: INFO networking_nsxv3.common.synchronization [None req-f42fc068-4b2e-490a-bc97-0ff1273ac616 None None] Enqueued Resource ID: 665ff128-e767-4606-b7a7-8571c54c81c6 with Priority: HIGHEST for action port [ 638.967628] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665ff128-e767-4606-b7a7-8571c54c81c6 with Priority: HIGHEST for action port [ 638.968206] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-665ff128-e767-4606-b7a7-8571c54c81c6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.968334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-665ff128-e767-4606-b7a7-8571c54c81c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.968403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-665ff128-e767-4606-b7a7-8571c54c81c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.968661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-665ff128-e767-4606-b7a7-8571c54c81c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.968736] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('665ff128-e767-4606-b7a7-8571c54c81c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.980802] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48e5829e-83e0-44d7-b9e9-c3210ec30d0d: rpc.has_security_group_logging(os_id): False [ 639.000088] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.000243] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.000317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.000540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.000730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.000966] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.001091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.001138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.001303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.001382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.001631] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.001768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.001854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.002041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.002104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.002297] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.002404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.002497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.002693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.002778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.002868] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d is going to be updated. [ 639.070384] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.070608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.070672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.070923] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.071121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.093513] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: IN_PROGRESS for 2s [ 639.268963] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 777e1cfe-d182-4171-a4f1-ea762602249c [ 639.268963] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.268963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.268963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.268963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.269231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.269936] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:777e1cfe-d182-4171-a4f1-ea762602249c already deleted. [ 639.270106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-777e1cfe-d182-4171-a4f1-ea762602249c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.423374] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb265379-c4fb-47cf-afb5-2c655df91dbf: rpc.has_security_group_logging(os_id): False [ 639.451180] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.451180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.451180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.451180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.451180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.451533] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.452462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.452462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.452462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.452462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.452462] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.452462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.452723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.453532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.453870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.454499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.454943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.455117] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.455303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.455388] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.455502] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb265379-c4fb-47cf-afb5-2c655df91dbf is going to be created. [ 639.471937] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 665ff128-e767-4606-b7a7-8571c54c81c6 [ 639.471937] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.471937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.471937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.471937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.471937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.471937] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:665ff128-e767-4606-b7a7-8571c54c81c6 already deleted. [ 639.471937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-665ff128-e767-4606-b7a7-8571c54c81c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.527739] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.527739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.527739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.527739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.527739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.541511] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb265379-c4fb-47cf-afb5-2c655df91dbf in Status: IN_PROGRESS for 2s [ 639.581844] env[65161]: INFO networking_nsxv3.common.synchronization [req-bbc0753e-e080-415d-94fb-04737ad683b5 req-cc0e1399-9b73-457e-9861-a1f20ce582c4 service nova] Enqueued Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGHEST for action security_group_rules [ 639.582892] env[65161]: INFO networking_nsxv3.common.synchronization [req-bbc0753e-e080-415d-94fb-04737ad683b5 req-cc0e1399-9b73-457e-9861-a1f20ce582c4 service nova] Enqueued Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGHEST for action security_group_members [ 639.583412] env[65161]: INFO networking_nsxv3.common.synchronization [req-bbc0753e-e080-415d-94fb-04737ad683b5 req-cc0e1399-9b73-457e-9861-a1f20ce582c4 service nova] Enqueued Resource ID: 539860a2-c4aa-4b65-84d0-f5ca958177e6 with Priority: HIGHEST for action port [ 639.585119] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGHEST for action security_group_rules [ 639.585119] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGHEST for action security_group_members [ 639.585119] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 539860a2-c4aa-4b65-84d0-f5ca958177e6 with Priority: HIGHEST for action port [ 639.585245] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.585419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.585468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.585854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.586465] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.589662] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.589846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.589914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.590089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.590247] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.590352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.590430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.590573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.590769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.590820] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.592425] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-539860a2-c4aa-4b65-84d0-f5ca958177e6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.592659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-539860a2-c4aa-4b65-84d0-f5ca958177e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.592659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-539860a2-c4aa-4b65-84d0-f5ca958177e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.593793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-539860a2-c4aa-4b65-84d0-f5ca958177e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.593793] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('539860a2-c4aa-4b65-84d0-f5ca958177e6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.095384] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.098834] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.098834] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 539860a2-c4aa-4b65-84d0-f5ca958177e6 with status ACTIVE [ 640.098834] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.098834] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.098834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.098834] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.099444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.099444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.099444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.101399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.101586] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 539860a2-c4aa-4b65-84d0-f5ca958177e6 is going to be updated. [ 640.127738] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.128016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.128016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.128247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.128388] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.128664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-539860a2-c4aa-4b65-84d0-f5ca958177e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.223807] env[65161]: INFO networking_nsxv3.common.synchronization [req-6d853930-42df-4e73-88c5-b0b68bc2bec2 req-bc2f8672-c5dd-4b6b-8b0c-ae3963f01516 tempest-ServerActionsV293TestJSON-816812624 tempest-ServerActionsV293TestJSON-816812624-project-member] Enqueued Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_members [ 640.224666] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_members [ 640.225170] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e16b48c-6389-4032-9e70-091f52c4106a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.225328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.225399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.225798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.225910] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.226015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.226015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.226219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.226321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.226321] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.604564] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.728509] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.728753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.728865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.729094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.729805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.729805] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.729805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.729805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.729805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.729805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.730232] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e16b48c-6389-4032-9e70-091f52c4106a already deleted. [ 640.730232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.852178] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.852178] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-425" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.852178] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-425" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.852178] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-425" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.852178] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.852756] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.853141] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.853535] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.853819] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.854179] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.854397] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.855393] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.855393] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.855393] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.855393] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.855393] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.878286] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.878667] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.878977] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.881287] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-425" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.881971] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-e28ac008-5acd-4bb4-932c-5143890f1d1e taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.882737] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-e28ac008-5acd-4bb4-932c-5143890f1d1e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.882997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-e28ac008-5acd-4bb4-932c-5143890f1d1e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.884130] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-e28ac008-5acd-4bb4-932c-5143890f1d1e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.884387] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e28ac008-5acd-4bb4-932c-5143890f1d1e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.107392] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.107392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.107392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.107392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.107392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.108686] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d is going to be created. [ 641.112543] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: SUCCESS [ 641.112765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.133932] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.134110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.134155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.134432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.134608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.149632] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d in Status: UNINITIALIZED for 2s [ 641.389382] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.389608] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.389773] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.390656] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.390656] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.390656] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port e28ac008-5acd-4bb4-932c-5143890f1d1e not found, creating... [ 641.390656] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.390838] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.390922] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.391154] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.391284] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.391556] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.392101] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.392101] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.392101] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.392294] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.392294] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: e28ac008-5acd-4bb4-932c-5143890f1d1e is going to be created. [ 641.417089] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.417360] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.417520] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.417810] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.418045] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.418302] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-e28ac008-5acd-4bb4-932c-5143890f1d1e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.553713] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb265379-c4fb-47cf-afb5-2c655df91dbf in Status: SUCCESS [ 641.554090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.141048] env[65161]: INFO networking_nsxv3.common.synchronization [req-6d853930-42df-4e73-88c5-b0b68bc2bec2 req-e3aa70e5-6525-4d25-a11f-98997720d79f service nova] Enqueued Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_rules [ 642.141389] env[65161]: INFO networking_nsxv3.common.synchronization [req-6d853930-42df-4e73-88c5-b0b68bc2bec2 req-e3aa70e5-6525-4d25-a11f-98997720d79f service nova] Enqueued Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_members [ 642.141389] env[65161]: INFO networking_nsxv3.common.synchronization [req-6d853930-42df-4e73-88c5-b0b68bc2bec2 req-e3aa70e5-6525-4d25-a11f-98997720d79f service nova] Enqueued Resource ID: e28ac008-5acd-4bb4-932c-5143890f1d1e with Priority: HIGHEST for action port [ 642.141891] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_rules [ 642.142304] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_members [ 642.142711] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e28ac008-5acd-4bb4-932c-5143890f1d1e with Priority: HIGHEST for action port [ 642.142776] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e16b48c-6389-4032-9e70-091f52c4106a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.142905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.143010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.144224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.144224] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.144224] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e16b48c-6389-4032-9e70-091f52c4106a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.144559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.144559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.144699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.144846] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.145213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.145311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.145474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.145566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.145658] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.147140] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e28ac008-5acd-4bb4-932c-5143890f1d1e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.147277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e28ac008-5acd-4bb4-932c-5143890f1d1e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.147399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e28ac008-5acd-4bb4-932c-5143890f1d1e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.147520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e28ac008-5acd-4bb4-932c-5143890f1d1e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.147599] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e28ac008-5acd-4bb4-932c-5143890f1d1e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.359213] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7f047ef5-a24b-4204-9e90-8b6225aa5be3 None None] Enqueued Resource ID: 0cffd985-6f77-4e6e-a557-3660740c13cb with Priority: HIGHEST for action port [ 642.362582] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cffd985-6f77-4e6e-a557-3660740c13cb with Priority: HIGHEST for action port [ 642.364193] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cffd985-6f77-4e6e-a557-3660740c13cb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.364334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cffd985-6f77-4e6e-a557-3660740c13cb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.364417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cffd985-6f77-4e6e-a557-3660740c13cb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.364778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cffd985-6f77-4e6e-a557-3660740c13cb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.364875] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cffd985-6f77-4e6e-a557-3660740c13cb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.649411] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.651637] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e16b48c-6389-4032-9e70-091f52c4106a taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.654937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.656239] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e28ac008-5acd-4bb4-932c-5143890f1d1e with status ACTIVE [ 642.656239] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.656239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.656239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.656239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.656239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.657963] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.657963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.657963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.661033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.661033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.661033] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.661033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.661033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.661033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.661033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.661033] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e28ac008-5acd-4bb4-932c-5143890f1d1e is going to be updated. [ 642.684745] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.684745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.684745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.684745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.684745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.684745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e28ac008-5acd-4bb4-932c-5143890f1d1e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.868692] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cffd985-6f77-4e6e-a557-3660740c13cb [ 642.868692] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.868692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.868692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.869429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.869429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.869429] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cffd985-6f77-4e6e-a557-3660740c13cb already deleted. [ 642.869429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cffd985-6f77-4e6e-a557-3660740c13cb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.162850] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d in Status: SUCCESS [ 643.163225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.163606] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.164953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.164953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.165156] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.165311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.165374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.165561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.165891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.166017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.166108] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.412952] env[65161]: INFO networking_nsxv3.common.synchronization [None req-d807ad72-4b87-4d60-9c9c-8a0fd56b4711 tempest-ServersTestBootFromVolume-330207307 tempest-ServersTestBootFromVolume-330207307-project-member] Enqueued Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_rules [ 643.414380] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_rules [ 643.414922] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd8909e-2253-4a61-b63b-9d668d108bb9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.415137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.415227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.415604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.415713] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.670879] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.671122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.671228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.671552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.671906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.671906] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e16b48c-6389-4032-9e70-091f52c4106a is going to be created. [ 643.673778] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.673928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.674163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.674401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.674613] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.674940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.674940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.675075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.675115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.675207] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.675392] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.675501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.675582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.675789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.675927] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.676292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.676292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.676292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.676449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.676485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.676559] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.705442] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.705791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.705791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.705953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.706013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.718565] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e16b48c-6389-4032-9e70-091f52c4106a in Status: UNINITIALIZED for 2s [ 643.829772] env[65161]: INFO networking_nsxv3.common.synchronization [None req-ac21775c-5e78-4624-86a2-8c1148f9d46b tempest-ServersTestBootFromVolume-330207307 tempest-ServersTestBootFromVolume-330207307-project-member] Enqueued Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_rules [ 643.830988] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_rules [ 643.830988] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd8909e-2253-4a61-b63b-9d668d108bb9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.830988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.942817] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.942817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.942817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.942817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.942817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.942817] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 already deleted. [ 643.942817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.942817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.942817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.942817] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.179032] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d: rpc.has_security_group_logging(os_id): False [ 644.197984] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.198710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.198710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.198710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.198710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.198867] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.198867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.198954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.199102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.199181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.200354] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.200468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.200536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.200734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.200801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.201038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.201140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.201179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.201361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.201418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.201450] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d is going to be created. [ 644.269135] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.269339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.269380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.269585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.269765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.280581] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d in Status: IN_PROGRESS for 2s [ 644.427122] env[65161]: INFO networking_nsxv3.common.synchronization [None req-0f3cfdce-7cca-4e32-914f-3edc8f9abc2f None None] Enqueued Resource ID: 6ef57f27-d888-4286-a5b0-6f5e038f0cb0 with Priority: HIGHEST for action port [ 644.427673] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef57f27-d888-4286-a5b0-6f5e038f0cb0 with Priority: HIGHEST for action port [ 644.427973] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ef57f27-d888-4286-a5b0-6f5e038f0cb0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.428560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ef57f27-d888-4286-a5b0-6f5e038f0cb0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.428620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ef57f27-d888-4286-a5b0-6f5e038f0cb0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.428928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ef57f27-d888-4286-a5b0-6f5e038f0cb0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.429055] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ef57f27-d888-4286-a5b0-6f5e038f0cb0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.470220] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.470369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.470436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.470683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.470791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.470890] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 already deleted. [ 644.470973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.931246] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ef57f27-d888-4286-a5b0-6f5e038f0cb0 [ 644.931802] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.931951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.932024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.932209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.932302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.932435] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ef57f27-d888-4286-a5b0-6f5e038f0cb0 already deleted. [ 644.932485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ef57f27-d888-4286-a5b0-6f5e038f0cb0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.220152] env[65161]: INFO networking_nsxv3.common.synchronization [req-29915a89-183e-49c7-bfdc-5e68f4620d69 req-3b9ba028-21d3-4259-9053-88ae8b123c00 tempest-ServersAdminNegativeTestJSON-1398107905 tempest-ServersAdminNegativeTestJSON-1398107905-project-member] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 645.220152] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 645.220152] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.220152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.220152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.220152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.220914] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.221167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.221326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.221586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.221824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.222023] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.725033] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.729308] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e16b48c-6389-4032-9e70-091f52c4106a in Status: SUCCESS [ 645.729595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.729829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.731435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.731435] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.731435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.731435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.731435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.731435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.731435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.731435] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.820945] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.821492] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.821752] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.822199] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.822642] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.822929] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.823134] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.823403] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.823569] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.823803] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.823922] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.824044] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.824160] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.824280] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.824391] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.824522] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.849431] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.849650] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.849811] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.850212] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.850392] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.850625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.850846] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.851315] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.852095] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('019c1bdf-a2cd-4c63-8d43-b8ceca02547c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.227706] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.234673] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.296068] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d in Status: SUCCESS [ 646.296311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.355285] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.355520] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.355642] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.355925] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.356090] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.356240] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 019c1bdf-a2cd-4c63-8d43-b8ceca02547c not found, creating... [ 646.356889] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.357088] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.357208] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.357422] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.357554] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.357829] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.357977] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.358100] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.358298] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.358425] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.358564] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 019c1bdf-a2cd-4c63-8d43-b8ceca02547c is going to be created. [ 646.379449] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.379675] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.379815] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.380257] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.380669] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.380971] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.730598] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.731067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.731067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.731067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.731289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.731289] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce is going to be updated. [ 646.736992] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e16b48c-6389-4032-9e70-091f52c4106a: rpc.has_security_group_logging(os_id): False [ 646.756969] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.757142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.757214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.757441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.757543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.757787] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.757887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.757951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.758114] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.758191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.758277] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e16b48c-6389-4032-9e70-091f52c4106a is going to be created. [ 646.764481] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.764616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.764662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.765255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.765255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.775463] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: IN_PROGRESS for 2s [ 646.829495] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.829636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.829708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.830049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.830137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.842644] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e16b48c-6389-4032-9e70-091f52c4106a in Status: IN_PROGRESS for 2s [ 646.935063] env[65161]: INFO networking_nsxv3.common.synchronization [None req-77ce60b9-7601-4058-a970-95c43bf927dd None None] Enqueued Resource ID: f43ea25f-f960-48e3-8fa7-97a5273e5c46 with Priority: HIGHEST for action port [ 646.935063] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43ea25f-f960-48e3-8fa7-97a5273e5c46 with Priority: HIGHEST for action port [ 646.935428] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f43ea25f-f960-48e3-8fa7-97a5273e5c46 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.935559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f43ea25f-f960-48e3-8fa7-97a5273e5c46" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.935625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f43ea25f-f960-48e3-8fa7-97a5273e5c46" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.935876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f43ea25f-f960-48e3-8fa7-97a5273e5c46" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.935954] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f43ea25f-f960-48e3-8fa7-97a5273e5c46',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.135276] env[65161]: INFO networking_nsxv3.common.synchronization [req-29915a89-183e-49c7-bfdc-5e68f4620d69 req-0186450b-93ef-40e4-a84e-8f87a7e203c0 service nova] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_rules [ 647.135276] env[65161]: INFO networking_nsxv3.common.synchronization [req-29915a89-183e-49c7-bfdc-5e68f4620d69 req-0186450b-93ef-40e4-a84e-8f87a7e203c0 service nova] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 647.135276] env[65161]: INFO networking_nsxv3.common.synchronization [req-29915a89-183e-49c7-bfdc-5e68f4620d69 req-0186450b-93ef-40e4-a84e-8f87a7e203c0 service nova] Enqueued Resource ID: 019c1bdf-a2cd-4c63-8d43-b8ceca02547c with Priority: HIGHEST for action port [ 647.135276] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_rules [ 647.135276] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 647.135276] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019c1bdf-a2cd-4c63-8d43-b8ceca02547c with Priority: HIGHEST for action port [ 647.135276] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.136387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.136690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.137017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.139066] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.139066] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.139066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.139264] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.139337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.139400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.142037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.142037] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('019c1bdf-a2cd-4c63-8d43-b8ceca02547c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.440742] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f43ea25f-f960-48e3-8fa7-97a5273e5c46 [ 647.441128] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.441198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.441251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.441429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.441512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.441624] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f43ea25f-f960-48e3-8fa7-97a5273e5c46 already deleted. [ 647.441803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f43ea25f-f960-48e3-8fa7-97a5273e5c46" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.643675] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.643675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.643944] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 019c1bdf-a2cd-4c63-8d43-b8ceca02547c with status ACTIVE [ 647.645970] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.645970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.645970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.646281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.646791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.646791] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.646791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.647026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.647907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.647907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.647907] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.647907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.647907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.648168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.648274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.648390] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 019c1bdf-a2cd-4c63-8d43-b8ceca02547c is going to be updated. [ 647.671621] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.671621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.671621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.671621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.671852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.671959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-019c1bdf-a2cd-4c63-8d43-b8ceca02547c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.701749] env[65161]: INFO networking_nsxv3.common.synchronization [None req-1af88fdd-93b6-4111-b087-76bd7b85fea7 None None] Enqueued Resource ID: c3b59c68-7fed-4e36-b551-da1dc5ae40b0 with Priority: HIGHEST for action port [ 647.702144] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3b59c68-7fed-4e36-b551-da1dc5ae40b0 with Priority: HIGHEST for action port [ 647.702477] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3b59c68-7fed-4e36-b551-da1dc5ae40b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.702638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3b59c68-7fed-4e36-b551-da1dc5ae40b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.703075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3b59c68-7fed-4e36-b551-da1dc5ae40b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.703075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3b59c68-7fed-4e36-b551-da1dc5ae40b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.703216] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3b59c68-7fed-4e36-b551-da1dc5ae40b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.205469] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3b59c68-7fed-4e36-b551-da1dc5ae40b0 [ 648.205723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.206105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.206105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.206227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.206273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.206372] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3b59c68-7fed-4e36-b551-da1dc5ae40b0 already deleted. [ 648.206463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3b59c68-7fed-4e36-b551-da1dc5ae40b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.788133] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: SUCCESS [ 648.788508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.788508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.788763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.788958] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.789086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.789150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.789336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.789421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.789518] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.860228] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e16b48c-6389-4032-9e70-091f52c4106a in Status: SUCCESS [ 648.860943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.245475] env[65161]: INFO networking_nsxv3.common.synchronization [req-86e1b4ca-47a4-49a2-a793-aa2e70caad40 req-afa9cf7a-63c0-47a7-b3cc-ece704b682e0 tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 649.246176] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 649.247177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.247177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.247177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.247177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.247177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.247434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.247434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.247503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.247601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.247696] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.293623] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.753606] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.753606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.753802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.754960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.754960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.754960] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.754960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.754960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.754960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.754960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.755603] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 already deleted. [ 649.755603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.758259] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.758439] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-133" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.758550] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-133" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.758951] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-133" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.759230] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.759385] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.759498] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.759718] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.759851] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.760099] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.760210] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.760314] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.760417] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.760521] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.760620] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.760766] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.785236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.785436] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.785530] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.785701] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-133" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.786059] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.786241] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.786357] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.786731] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.786871] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff8b556-8b18-456a-b1a6-f2fecb63b1df',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.794917] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.284441] env[65161]: INFO networking_nsxv3.common.synchronization [None req-f3abd65e-feea-4172-a72e-0340a2113240 None None] Enqueued Resource ID: af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67 with Priority: HIGHEST for action port [ 650.284441] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67 with Priority: HIGHEST for action port [ 650.284925] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.285206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.285396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.285779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.286051] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.290467] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.290467] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.290467] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.290467] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.290467] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.292202] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 5ff8b556-8b18-456a-b1a6-f2fecb63b1df not found, creating... [ 650.292331] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.292534] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.292698] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.292970] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.293164] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.293525] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.293699] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.293825] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.294127] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.294538] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.294538] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df is going to be created. [ 650.302502] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.303124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.303124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.303124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.303124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.303124] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce is going to be updated. [ 650.319591] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.320042] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.320369] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.320970] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.321212] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.321828] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.340100] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.340281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.340353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.340626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.341030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.356642] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: IN_PROGRESS for 2s [ 650.788929] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67 [ 650.789259] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.789364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.789437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.789660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.789751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.789848] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67 already deleted. [ 650.789928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af9bfce1-c92e-4d33-bca1-8ad0f6b1fc67" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.118279] env[65161]: INFO networking_nsxv3.common.synchronization [req-86e1b4ca-47a4-49a2-a793-aa2e70caad40 req-d4d123a9-e7ec-482d-b079-774cc8bfd092 service nova] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 651.118520] env[65161]: INFO networking_nsxv3.common.synchronization [req-86e1b4ca-47a4-49a2-a793-aa2e70caad40 req-d4d123a9-e7ec-482d-b079-774cc8bfd092 service nova] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 651.118565] env[65161]: INFO networking_nsxv3.common.synchronization [req-86e1b4ca-47a4-49a2-a793-aa2e70caad40 req-d4d123a9-e7ec-482d-b079-774cc8bfd092 service nova] Enqueued Resource ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with Priority: HIGHEST for action port [ 651.119108] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 651.119245] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 651.119735] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with Priority: HIGHEST for action port [ 651.121133] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.121133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.121133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.121133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.121133] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.121854] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.121946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.122021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.122192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.122330] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.122418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.122537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.122606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.122685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.122834] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.123489] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.123615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.123677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.123803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.123893] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff8b556-8b18-456a-b1a6-f2fecb63b1df',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.627146] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.628915] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.628915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.630317] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with status ACTIVE [ 651.630655] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.630655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.630761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.632183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.632183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.632183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.632183] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df is going to be updated. [ 651.659566] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.659710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.659710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.661187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.661187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.661187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.780124] env[65161]: INFO networking_nsxv3.common.synchronization [req-0b8972a9-2fd0-42ff-a8e3-44d3a79aa2b7 req-889be978-9e2a-42a4-bda7-6dd1b5c4e874 tempest-ImagesNegativeTestJSON-536901030 tempest-ImagesNegativeTestJSON-536901030-project-member] Enqueued Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGHEST for action security_group_members [ 651.780124] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGHEST for action security_group_members [ 651.781189] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd743095-5c04-42e0-a757-109988198d4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.781352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.781421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.781637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.781916] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.782057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.782178] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.782293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.782380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.782492] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.131390] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.286521] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.286716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.286806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.287115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.287237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.287501] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.287619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.287684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.287901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.288048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.288157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd743095-5c04-42e0-a757-109988198d4e is going to be updated. [ 652.328670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.328670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.328670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.328670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.328670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.340363] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd743095-5c04-42e0-a757-109988198d4e in Status: IN_PROGRESS for 2s [ 652.368894] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: SUCCESS [ 652.368894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.368894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.368894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.368894] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.368894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.368894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.369201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.369201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.369265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.369785] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.638467] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.638467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.638467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.638467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.638467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.638467] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be created. [ 652.670611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.670954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.671081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.671642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.671987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.688685] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: UNINITIALIZED for 2s [ 652.877036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.877036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.877036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.877036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.877036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.877036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.877036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.877036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.877036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.877036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.877625] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.877873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.878047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.878343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.879768] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.880090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.880312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.880601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.880854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.881133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.881337] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.884038] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ebafa7c-af0d-4676-9859-cb9a9c4b77ef req-ea35c1b4-89e8-4bf8-83ba-9aef1f93ee20 tempest-ServerDiagnosticsTest-860235650 tempest-ServerDiagnosticsTest-860235650-project-member] Enqueued Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGHEST for action security_group_members [ 652.884688] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGHEST for action security_group_members [ 652.885257] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.885837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.885837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.890049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.890049] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.890049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.890049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.890049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.890049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.890049] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.290395] env[65161]: INFO networking_nsxv3.common.synchronization [None req-a971e8c5-ebee-4784-809b-97df63b71f4a None None] Enqueued Resource ID: 8886fece-062e-4395-963e-e8ce76b420ab with Priority: HIGHEST for action port [ 653.291272] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8886fece-062e-4395-963e-e8ce76b420ab with Priority: HIGHEST for action port [ 653.291443] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8886fece-062e-4395-963e-e8ce76b420ab taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.291647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8886fece-062e-4395-963e-e8ce76b420ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.291812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8886fece-062e-4395-963e-e8ce76b420ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.292141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8886fece-062e-4395-963e-e8ce76b420ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.292356] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8886fece-062e-4395-963e-e8ce76b420ab',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.385874] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45c3c240-33f4-4e4c-b0dc-526406810cce: rpc.has_security_group_logging(os_id): False [ 653.395553] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.395984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.399234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.399234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.399234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.399234] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.399234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.399234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.399234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.399234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.399234] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f already deleted. [ 653.399234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.411030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.411030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.411030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.411030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.411670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.412210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.412520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.412834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.413067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.413821] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce is going to be updated. [ 653.483944] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.486175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.486175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.486175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.486175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.500638] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: IN_PROGRESS for 2s [ 653.798313] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8886fece-062e-4395-963e-e8ce76b420ab [ 653.798602] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.798762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.798851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.799149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.799255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.799362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8886fece-062e-4395-963e-e8ce76b420ab already deleted. [ 653.799467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8886fece-062e-4395-963e-e8ce76b420ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.288868] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.289135] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.289268] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.289540] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.289809] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.290219] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.290943] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.291238] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.291390] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.291657] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.291747] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.291819] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.291907] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.292025] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.292255] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.292255] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.323811] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.324131] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.324471] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.324609] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.325100] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.325432] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.325531] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.326668] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.327744] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcdebebc-4e03-48b7-b085-494dd4a9bb0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.358949] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd743095-5c04-42e0-a757-109988198d4e in Status: SUCCESS [ 654.358949] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd743095-5c04-42e0-a757-109988198d4e deletion is rescheduled due to dependency. [ 654.358949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.526110] env[65161]: INFO networking_nsxv3.common.synchronization [None req-945d7a6b-54ba-4474-b946-e1b954ca225d None None] Enqueued Resource ID: cdc521a1-6ef1-4452-af81-185b95569153 with Priority: HIGHEST for action port [ 654.528749] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc521a1-6ef1-4452-af81-185b95569153 with Priority: HIGHEST for action port [ 654.528749] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdc521a1-6ef1-4452-af81-185b95569153 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.529326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdc521a1-6ef1-4452-af81-185b95569153" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.529588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdc521a1-6ef1-4452-af81-185b95569153" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.530778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdc521a1-6ef1-4452-af81-185b95569153" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.530778] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc521a1-6ef1-4452-af81-185b95569153',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.698362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 654.698619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.698832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.699059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.699238] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.699357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.699422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.699644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.699644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.699730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.699821] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.831212] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.831506] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.831573] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.832604] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.832604] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.832604] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port bcdebebc-4e03-48b7-b085-494dd4a9bb0d not found, creating... [ 654.832775] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.832988] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.832988] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.833192] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.833330] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.833612] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.834024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.834024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.834299] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.834451] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.834591] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: bcdebebc-4e03-48b7-b085-494dd4a9bb0d is going to be created. [ 654.856242] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.857277] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.857485] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.857812] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.858085] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.858349] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.035702] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdc521a1-6ef1-4452-af81-185b95569153 [ 655.035909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.036067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.036172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.036368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.036462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.036620] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdc521a1-6ef1-4452-af81-185b95569153 already deleted. [ 655.036706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdc521a1-6ef1-4452-af81-185b95569153" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.206381] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.523206] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: SUCCESS [ 655.523598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.666518] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ebafa7c-af0d-4676-9859-cb9a9c4b77ef req-c9d25d58-dde3-40fc-a20b-8bb5c43734f3 service nova] Enqueued Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGHEST for action security_group_rules [ 655.666518] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ebafa7c-af0d-4676-9859-cb9a9c4b77ef req-c9d25d58-dde3-40fc-a20b-8bb5c43734f3 service nova] Enqueued Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGHEST for action security_group_members [ 655.666518] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ebafa7c-af0d-4676-9859-cb9a9c4b77ef req-c9d25d58-dde3-40fc-a20b-8bb5c43734f3 service nova] Enqueued Resource ID: bcdebebc-4e03-48b7-b085-494dd4a9bb0d with Priority: HIGHEST for action port [ 655.666840] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGHEST for action security_group_rules [ 655.666840] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGHEST for action security_group_members [ 655.666958] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcdebebc-4e03-48b7-b085-494dd4a9bb0d with Priority: HIGHEST for action port [ 655.669096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.669277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.669364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.671040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.671040] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.673280] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.673697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.673697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.673988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.674154] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.674154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.674254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.674482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.674606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.674726] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.679418] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.679571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.679658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.679871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.679958] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcdebebc-4e03-48b7-b085-494dd4a9bb0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.709400] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5eae70bb-b2d5-4683-837e-e701a57929f1: rpc.has_security_group_logging(os_id): False [ 655.736147] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.736147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.736147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.736147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.736147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.736147] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.737324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.737451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.737738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.739037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.739037] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be created. [ 655.820167] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.820378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.820378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.820977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.820977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.839567] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: IN_PROGRESS for 2s [ 656.032133] env[65161]: INFO networking_nsxv3.common.synchronization [req-ef99b115-2a4f-4700-b0d3-14a53cbef04d req-c615ff09-7ad6-43dc-b226-959e59ed3baf tempest-ServersAdminTestJSON-2133010713 tempest-ServersAdminTestJSON-2133010713-project-member] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 656.036802] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 656.036802] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.036802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.036802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.036802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.036802] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.036802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.036802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.036802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.036802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.036802] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.182881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.182881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.184559] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcdebebc-4e03-48b7-b085-494dd4a9bb0d with status ACTIVE [ 656.184773] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.185039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.185039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.185377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.185377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.185523] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.185608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.185672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.185838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.185962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.186331] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.186501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.186501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.186687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.186795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.187101] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcdebebc-4e03-48b7-b085-494dd4a9bb0d is going to be updated. [ 656.194035] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.445311] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.445506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.445506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.445738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.445875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.446048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcdebebc-4e03-48b7-b085-494dd4a9bb0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.532143] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-741 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.532143] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.532143] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.532143] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.532143] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.532143] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.532823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.532823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.532823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.532823] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.532823] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.533181] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.533181] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.533181] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.533327] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.533444] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.541176] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.575078] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.575078] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.575078] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.575078] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.575078] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.575078] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.575078] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.575078] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.575563] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b547a9f-13fb-48ca-a42a-3bdb24878fe6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.694404] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.757867] env[65161]: INFO networking_nsxv3.common.synchronization [req-b225e01e-acae-450d-81b6-7186633a1786 req-cd7f348e-dcc0-4ba7-8ca5-67f221b10ad4 tempest-FloatingIPsAssociationNegativeTestJSON-497829059 tempest-FloatingIPsAssociationNegativeTestJSON-497829059-project-member] Enqueued Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGHEST for action security_group_members [ 656.758445] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGHEST for action security_group_members [ 656.758971] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d23f6bd-c3d6-4abc-b853-77560027d5d9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.760596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.760596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.760596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.760865] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.760865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.760958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.761240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.761944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.762070] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.044073] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.082042] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.082217] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.082363] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.083821] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.084037] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.084250] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 3b547a9f-13fb-48ca-a42a-3bdb24878fe6 not found, creating... [ 657.084651] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.085630] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.085630] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.085630] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.085630] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.087205] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.087205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.087205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.087205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.087385] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.087424] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 3b547a9f-13fb-48ca-a42a-3bdb24878fe6 is going to be created. [ 657.115248] env[65161]: INFO networking_nsxv3.common.synchronization [None req-91200786-d338-4244-9001-6b92acaa2664 None None] Enqueued Resource ID: 2babb236-8b5b-4dc2-8e35-7551a826fc85 with Priority: HIGHEST for action port [ 657.116897] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.117213] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.117481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.117774] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.118583] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.118881] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.119929] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2babb236-8b5b-4dc2-8e35-7551a826fc85 with Priority: HIGHEST for action port [ 657.120489] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-2babb236-8b5b-4dc2-8e35-7551a826fc85 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.120619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2babb236-8b5b-4dc2-8e35-7551a826fc85" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.120689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2babb236-8b5b-4dc2-8e35-7551a826fc85" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.120997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2babb236-8b5b-4dc2-8e35-7551a826fc85" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.121130] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2babb236-8b5b-4dc2-8e35-7551a826fc85',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.198687] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.199209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.199588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.199588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.199788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.199866] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f is going to be created. [ 657.251153] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.251153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.251153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.251153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.251153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.266277] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.266524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.266612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.266874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.266978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.267217] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.267323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.267384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.267586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.267681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.267849] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 already deleted. [ 657.267849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.268968] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f in Status: UNINITIALIZED for 2s [ 657.415447] env[65161]: INFO networking_nsxv3.common.synchronization [None req-3639cff1-ec84-47c0-919e-d5f45addb4c9 None None] Enqueued Resource ID: 1af86156-fe4c-42e7-8f6f-4a5a6fb3669d with Priority: HIGHEST for action port [ 657.415447] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af86156-fe4c-42e7-8f6f-4a5a6fb3669d with Priority: HIGHEST for action port [ 657.415447] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-1af86156-fe4c-42e7-8f6f-4a5a6fb3669d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.415447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1af86156-fe4c-42e7-8f6f-4a5a6fb3669d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.415447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1af86156-fe4c-42e7-8f6f-4a5a6fb3669d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.415447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1af86156-fe4c-42e7-8f6f-4a5a6fb3669d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.415447] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1af86156-fe4c-42e7-8f6f-4a5a6fb3669d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.435193] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.435193] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-197" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.435193] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-197" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.435505] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-197" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.436320] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.436320] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.436320] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.436569] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.436682] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.436888] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.437000] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.437117] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.437242] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.437789] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.437789] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.438017] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.458818] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.458818] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.458818] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.458818] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-197" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.459162] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-922b0190-d9b0-4ced-bbe6-380715f9b7d2 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.459317] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-922b0190-d9b0-4ced-bbe6-380715f9b7d2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.459433] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-922b0190-d9b0-4ced-bbe6-380715f9b7d2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.459755] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-922b0190-d9b0-4ced-bbe6-380715f9b7d2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.460379] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922b0190-d9b0-4ced-bbe6-380715f9b7d2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.546113] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.546113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.546113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.546804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.546804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.546804] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 657.616525] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.616525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.616525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.616525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.616908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.624451] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2babb236-8b5b-4dc2-8e35-7551a826fc85 [ 657.624707] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.624862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.624920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.625192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.625313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.625443] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2babb236-8b5b-4dc2-8e35-7551a826fc85 already deleted. [ 657.625528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2babb236-8b5b-4dc2-8e35-7551a826fc85" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.631724] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 657.846426] env[65161]: INFO networking_nsxv3.common.synchronization [req-ef99b115-2a4f-4700-b0d3-14a53cbef04d req-8012cb58-6e56-438a-b995-59f4342b74aa service nova] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_rules [ 657.849356] env[65161]: INFO networking_nsxv3.common.synchronization [req-ef99b115-2a4f-4700-b0d3-14a53cbef04d req-8012cb58-6e56-438a-b995-59f4342b74aa service nova] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 657.849356] env[65161]: INFO networking_nsxv3.common.synchronization [req-ef99b115-2a4f-4700-b0d3-14a53cbef04d req-8012cb58-6e56-438a-b995-59f4342b74aa service nova] Enqueued Resource ID: 3b547a9f-13fb-48ca-a42a-3bdb24878fe6 with Priority: HIGHEST for action port [ 657.849356] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_rules [ 657.849356] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 657.849356] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b547a9f-13fb-48ca-a42a-3bdb24878fe6 with Priority: HIGHEST for action port [ 657.849356] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.850130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.850591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.851040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.851238] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.852493] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.852773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.853135] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.853432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.853599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.854102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.854327] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b547a9f-13fb-48ca-a42a-3bdb24878fe6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.861848] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 657.861848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.917841] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1af86156-fe4c-42e7-8f6f-4a5a6fb3669d [ 657.918367] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.918367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.918367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.918616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.919038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.919038] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1af86156-fe4c-42e7-8f6f-4a5a6fb3669d already deleted. [ 657.919038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1af86156-fe4c-42e7-8f6f-4a5a6fb3669d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.963985] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.963985] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.964238] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.964290] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.965697] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.965697] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 922b0190-d9b0-4ced-bbe6-380715f9b7d2 not found, creating... [ 657.965697] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.965697] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.965697] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.965697] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.965697] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.965982] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.965982] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.966090] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.967581] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.967581] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.967581] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 922b0190-d9b0-4ced-bbe6-380715f9b7d2 is going to be created. [ 657.992634] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.992873] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.993257] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.993445] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.996587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.996587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-922b0190-d9b0-4ced-bbe6-380715f9b7d2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.356275] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.356275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.356625] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b547a9f-13fb-48ca-a42a-3bdb24878fe6 with status ACTIVE [ 658.356661] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.357057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.357057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.357252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.357311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.357497] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.358140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.358140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.358140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.358140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.358140] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.358371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.358371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.358451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.358451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.358540] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b547a9f-13fb-48ca-a42a-3bdb24878fe6 is going to be updated. [ 658.384200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.384378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.384437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.384695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.384846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.385115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b547a9f-13fb-48ca-a42a-3bdb24878fe6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.815030] env[65161]: INFO networking_nsxv3.common.synchronization [req-b225e01e-acae-450d-81b6-7186633a1786 req-5c932b9d-d664-4fe0-9953-77e5b709149e service nova] Enqueued Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGHEST for action security_group_rules [ 658.815455] env[65161]: INFO networking_nsxv3.common.synchronization [req-b225e01e-acae-450d-81b6-7186633a1786 req-5c932b9d-d664-4fe0-9953-77e5b709149e service nova] Enqueued Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGHEST for action security_group_members [ 658.815455] env[65161]: INFO networking_nsxv3.common.synchronization [req-b225e01e-acae-450d-81b6-7186633a1786 req-5c932b9d-d664-4fe0-9953-77e5b709149e service nova] Enqueued Resource ID: 922b0190-d9b0-4ced-bbe6-380715f9b7d2 with Priority: HIGHEST for action port [ 658.816030] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGHEST for action security_group_rules [ 658.816250] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGHEST for action security_group_members [ 658.816388] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 922b0190-d9b0-4ced-bbe6-380715f9b7d2 with Priority: HIGHEST for action port [ 658.816713] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.816963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.817059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.817829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.817829] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.819777] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d23f6bd-c3d6-4abc-b853-77560027d5d9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.820168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.820168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.820421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.820696] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.820877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.820993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.821279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.821415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.821582] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.823041] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-922b0190-d9b0-4ced-bbe6-380715f9b7d2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.823163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-922b0190-d9b0-4ced-bbe6-380715f9b7d2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.823205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-922b0190-d9b0-4ced-bbe6-380715f9b7d2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.823499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-922b0190-d9b0-4ced-bbe6-380715f9b7d2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.823644] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922b0190-d9b0-4ced-bbe6-380715f9b7d2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.281444] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f in Status: SUCCESS [ 659.281806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.281806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.281946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.282192] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.282799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.282799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.282799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.282799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.282799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.283404] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.326286] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d23f6bd-c3d6-4abc-b853-77560027d5d9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.326486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.327806] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 922b0190-d9b0-4ced-bbe6-380715f9b7d2 with status ACTIVE [ 659.328035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.328204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.328243] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.328478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.328585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.328784] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.328903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.328960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.329145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.329216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.329434] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.329544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.329601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.329729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.329800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.329916] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 922b0190-d9b0-4ced-bbe6-380715f9b7d2 is going to be updated. [ 659.331402] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.355972] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.356407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.356407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.356654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.356854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.357221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-922b0190-d9b0-4ced-bbe6-380715f9b7d2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.642907] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 659.643251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.643475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.643752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.644399] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.644399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.644399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.644399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.644399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.644704] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.785722] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.785981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.785981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.786181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.786710] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.786919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.787329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.787423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.787484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.787568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.787832] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.787968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.788067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.788205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.788358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.788467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.788546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.788652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.788826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.788911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.789078] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.836862] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.148758] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.272234] env[65161]: INFO networking_nsxv3.common.synchronization [req-4cdd7368-1255-4ba8-a1f3-0a7485798944 req-a03afc2c-23f4-4389-a698-16da9f468cab tempest-DeleteServersAdminTestJSON-344791916 tempest-DeleteServersAdminTestJSON-344791916-project-member] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 660.272764] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 660.274933] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.274933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.274933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.274933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.274933] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.274933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.274933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.274933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.274933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.274933] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.292605] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f: rpc.has_security_group_logging(os_id): False [ 660.315231] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.315383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.315453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.315675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.315756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.315944] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.316061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.316116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.316529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.316529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.316529] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.316688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.316688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.316794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.316857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.317100] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.317216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.317279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.317578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.317578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.317728] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f is going to be created. [ 660.342601] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.342601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.342601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.342601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.342601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.342601] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 is going to be created. [ 660.368281] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.368281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.368281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.369254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.369254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.379734] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 in Status: UNINITIALIZED for 2s [ 660.388314] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.388516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.388585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.389720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.389720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.405452] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f in Status: IN_PROGRESS for 2s [ 660.634276] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.634468] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.634592] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.634906] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.635202] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.635329] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.635440] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.635670] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.635812] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.636047] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.636154] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.636268] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.636371] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.636472] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.636570] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.636708] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.650751] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.659586] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.659783] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.659885] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.660210] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.660422] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.660617] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.660740] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.661199] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.661336] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54ed4ae0-dd41-458d-ab39-3d8bb43a8de1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.776963] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.777269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.777269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.777499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.777595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.777852] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.778027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.778027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.778204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.778280] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.778366] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 is going to be updated. [ 660.836095] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.836346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.836453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.836760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.836954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.847655] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: IN_PROGRESS for 2s [ 661.153257] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.153445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.153508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.153703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.153790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.153888] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 661.165704] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.165920] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.166376] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.166376] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.166502] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.166691] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 54ed4ae0-dd41-458d-ab39-3d8bb43a8de1 not found, creating... [ 661.166983] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.167204] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.167381] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.167589] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.167741] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.168356] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.168356] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.168614] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.168762] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.168971] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.169164] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 54ed4ae0-dd41-458d-ab39-3d8bb43a8de1 is going to be created. [ 661.191579] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.191823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.191977] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.192342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.193096] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.193096] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.194669] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.194797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.194879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.195128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.195261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.206736] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 662.133818] env[65161]: INFO networking_nsxv3.common.synchronization [req-4cdd7368-1255-4ba8-a1f3-0a7485798944 req-bcbed910-1eeb-4139-b6f5-91ff592f1995 service nova] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_rules [ 662.133818] env[65161]: INFO networking_nsxv3.common.synchronization [req-4cdd7368-1255-4ba8-a1f3-0a7485798944 req-bcbed910-1eeb-4139-b6f5-91ff592f1995 service nova] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 662.133818] env[65161]: INFO networking_nsxv3.common.synchronization [req-4cdd7368-1255-4ba8-a1f3-0a7485798944 req-bcbed910-1eeb-4139-b6f5-91ff592f1995 service nova] Enqueued Resource ID: 54ed4ae0-dd41-458d-ab39-3d8bb43a8de1 with Priority: HIGHEST for action port [ 662.133818] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_rules [ 662.133818] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 662.133818] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ed4ae0-dd41-458d-ab39-3d8bb43a8de1 with Priority: HIGHEST for action port [ 662.133818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.133818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.133818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.133818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.133818] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.133818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.133818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.133818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.133818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.133818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.133818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.133818] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54ed4ae0-dd41-458d-ab39-3d8bb43a8de1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.391855] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 in Status: SUCCESS [ 662.392262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.392324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.392561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.392772] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.392900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.392958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.393127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.393228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.393780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.393780] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.418320] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f in Status: SUCCESS [ 662.418320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.517561] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.517847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.518034] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54ed4ae0-dd41-458d-ab39-3d8bb43a8de1 with status ACTIVE [ 662.518345] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.518520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.518613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.518918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.519073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.519347] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.519461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.519541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.519693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.519776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.520061] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.520209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.520278] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.520455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.520531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.520620] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54ed4ae0-dd41-458d-ab39-3d8bb43a8de1 is going to be updated. [ 662.545610] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.545839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.545888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.546103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.546261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.546628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54ed4ae0-dd41-458d-ab39-3d8bb43a8de1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.860304] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: SUCCESS [ 662.860769] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 deletion is rescheduled due to dependency. [ 662.860769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.860769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.861170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.861342] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.861442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.861507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.861789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.861789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.861967] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.895925] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d23f6bd-c3d6-4abc-b853-77560027d5d9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.896136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.896730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.896730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.896730] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.896955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.896955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.897049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.897252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.897252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.897478] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d23f6bd-c3d6-4abc-b853-77560027d5d9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.898125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.898125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.898125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.898125] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.898125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.898125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.898378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.898378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.898522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.898638] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.220353] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 4s [ 663.365055] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.401131] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d23f6bd-c3d6-4abc-b853-77560027d5d9: rpc.has_security_group_logging(os_id): False [ 663.426773] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.426965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.427040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.427373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.427487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.428160] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.428160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.428160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.428160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.428160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.428464] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.428464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.428464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.428664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.428664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.428759] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.428920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.428920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.429746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.429746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.429746] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 is going to be created. [ 663.502080] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.503044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.503226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.503483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.503828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.519450] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 in Status: IN_PROGRESS for 2s [ 663.872038] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.372034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.375138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.375138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.375138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.375138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.375138] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 is going to be updated. [ 664.413801] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.413914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.414040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.414359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.414673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.427318] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: IN_PROGRESS for 2s [ 664.734849] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1d016ff-26a6-4a78-b9ab-ba22d2df2497 req-f944e477-d18e-4241-892d-21c61e3d2ae9 tempest-SecurityGroupRulesTestJSON-6335183 tempest-SecurityGroupRulesTestJSON-6335183-project-member] Enqueued Resource ID: 1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e with Priority: HIGHEST for action security_group_rules [ 664.735155] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e with Priority: HIGHEST for action security_group_rules [ 664.735355] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.735496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.735579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.735866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.735952] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.885051] env[65161]: INFO networking_nsxv3.common.synchronization [req-c398c034-522b-4822-990c-8e572bcc3a74 req-f9bee6cb-cb59-49c1-945c-2b1ae2663229 tempest-InstanceActionsNegativeTestJSON-996522854 tempest-InstanceActionsNegativeTestJSON-996522854-project-member] Enqueued Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGHEST for action security_group_members [ 664.887207] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGHEST for action security_group_members [ 664.888749] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.889289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.889448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.890442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.891324] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.892096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.892096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.892322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.892775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.892865] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.233027] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 665.233393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.233484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.233696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.233881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.234134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.234134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.234312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.234400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.234493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.234587] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.263070] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.263949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.263949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.263949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.263949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.263949] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e already deleted. [ 665.263949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a7c3818-c54c-4aea-bfdf-bcc94ce3de0e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.396593] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.396927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.396927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.397516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.397516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.397516] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.397816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.397816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.398480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.398480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.398480] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 already deleted. [ 665.398480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.446318] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-395 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.450014] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-395" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.450014] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-395" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.450014] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-395" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.450014] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.450014] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.450014] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.450014] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.450014] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.450014] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.450014] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.450014] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.450014] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.450014] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.450014] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.450014] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.470145] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.470893] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.470893] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.470893] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-395" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.471124] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-72411598-22a8-488b-9c2b-9b9ed7e75137 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.471261] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-72411598-22a8-488b-9c2b-9b9ed7e75137" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.471405] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-72411598-22a8-488b-9c2b-9b9ed7e75137" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.471745] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-72411598-22a8-488b-9c2b-9b9ed7e75137" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.472067] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72411598-22a8-488b-9c2b-9b9ed7e75137',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.535762] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 in Status: SUCCESS [ 665.536726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.659522] env[65161]: INFO networking_nsxv3.common.synchronization [req-f35ec3ef-9e22-426c-93ba-f5c13eb663e8 req-bea6d069-4eef-4a0b-8443-724d410c2b83 tempest-ServerDiagnosticsNegativeTest-296237889 tempest-ServerDiagnosticsNegativeTest-296237889-project-member] Enqueued Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGHEST for action security_group_members [ 665.660131] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGHEST for action security_group_members [ 665.660448] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.660591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.660673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.661782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.661957] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.662786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.662872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.663124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.663222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.663326] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.737039] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.737218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.737327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.737538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.737725] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.737828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.737893] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.738202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.738300] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.738393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.738540] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.738649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.738961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.739185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.739337] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.739436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.739568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.739636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.740035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.740139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.740233] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.975315] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.975687] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.975911] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.976326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.976439] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.977024] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 72411598-22a8-488b-9c2b-9b9ed7e75137 not found, creating... [ 665.977024] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.977373] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.977373] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.978679] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.978679] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.978679] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.978679] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.978679] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.978679] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.979929] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.979929] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 72411598-22a8-488b-9c2b-9b9ed7e75137 is going to be created. [ 666.008945] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.009301] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.009465] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.009817] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.010059] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.010494] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-72411598-22a8-488b-9c2b-9b9ed7e75137" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.166767] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.167010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.167156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.167470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.167577] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.167874] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.168020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.168093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.168270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.168404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.168468] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d is going to be updated. [ 666.219166] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.219510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.219510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.219770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.219930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.239084] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d in Status: IN_PROGRESS for 2s [ 666.245301] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22b5f607-a69e-46b7-93e8-49d4437a6864: rpc.has_security_group_logging(os_id): False [ 666.270588] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.270588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.270588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.270900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.270900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.271359] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.271578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.271665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.272034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.272034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.272272] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.273398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.273398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.273398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.273398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.273398] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.273398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.273398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.273398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.273398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.274021] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 666.389354] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.389568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.389568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.389806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.389993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.410616] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 666.447746] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: SUCCESS [ 666.447746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.447746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.447746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.447746] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.447746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.447746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.447746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.447746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.447746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.447746] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.886532] env[65161]: INFO networking_nsxv3.common.synchronization [req-c398c034-522b-4822-990c-8e572bcc3a74 req-bc5442a3-4361-4a84-8eaa-770053ec27ea service nova] Enqueued Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGHEST for action security_group_rules [ 666.888317] env[65161]: INFO networking_nsxv3.common.synchronization [req-c398c034-522b-4822-990c-8e572bcc3a74 req-bc5442a3-4361-4a84-8eaa-770053ec27ea service nova] Enqueued Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGHEST for action security_group_members [ 666.888317] env[65161]: INFO networking_nsxv3.common.synchronization [req-c398c034-522b-4822-990c-8e572bcc3a74 req-bc5442a3-4361-4a84-8eaa-770053ec27ea service nova] Enqueued Resource ID: 72411598-22a8-488b-9c2b-9b9ed7e75137 with Priority: HIGHEST for action port [ 666.888317] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGHEST for action security_group_rules [ 666.888317] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGHEST for action security_group_members [ 666.888317] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72411598-22a8-488b-9c2b-9b9ed7e75137 with Priority: HIGHEST for action port [ 666.888790] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.888790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.888790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.889077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.889206] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.890430] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.890605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.890728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.892856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.892977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.893078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.893163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.893358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.893447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.893593] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.898705] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-72411598-22a8-488b-9c2b-9b9ed7e75137 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.898949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72411598-22a8-488b-9c2b-9b9ed7e75137" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.899038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72411598-22a8-488b-9c2b-9b9ed7e75137" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.899235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72411598-22a8-488b-9c2b-9b9ed7e75137" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.899359] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72411598-22a8-488b-9c2b-9b9ed7e75137',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.954909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.954909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.954909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.955980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.955980] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.955980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.955980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.955980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.956272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.956272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.956464] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.956605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.956685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.956916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.957166] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.957295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.957295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.957526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.957611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.957688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.957793] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.401915] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.403785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.404114] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.404268] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72411598-22a8-488b-9c2b-9b9ed7e75137 with status ACTIVE [ 667.404555] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.404748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.404881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.405268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.405443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.406657] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.406844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.406934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.407194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.407292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.407481] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.407703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.407742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.407893] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.407978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.408183] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72411598-22a8-488b-9c2b-9b9ed7e75137 is going to be updated. [ 667.431341] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.431729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.431729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.431810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.431983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.432150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72411598-22a8-488b-9c2b-9b9ed7e75137" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.462859] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9daee2fc-9524-40ce-9dad-b50ca4273bc4: rpc.has_security_group_logging(os_id): False [ 667.484030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.484030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.484030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.484810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.484937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.485189] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.485298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.485395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.485526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.485602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.485799] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.485931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.485978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.487536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.487791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.488049] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.489684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.489684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.489684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.489684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.489684] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 is going to be updated. [ 667.593420] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.593573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.593638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.593847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.597154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.630133] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: IN_PROGRESS for 2s [ 667.911143] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.250510] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d in Status: SUCCESS [ 668.250510] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d deletion is rescheduled due to dependency. [ 668.250510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.419179] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.419341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.419462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.419722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.419816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.419953] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 is going to be created. [ 668.434603] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 668.434867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.445822] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.446158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.446158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.446358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.446425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.461676] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 in Status: UNINITIALIZED for 2s [ 668.667868] env[65161]: INFO networking_nsxv3.common.synchronization [req-3b54ac4d-0b59-4c1e-8e1e-14aa4797a846 req-16e02288-8803-480e-aa7f-04e132181459 tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 668.668392] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 668.668702] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.668848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.668959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.669193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.669380] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.669519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.669587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.669701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.669786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.669882] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.175622] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.175622] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.175622] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad already deleted. [ 669.175622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.418712] env[65161]: INFO networking_nsxv3.common.synchronization [req-2a162c83-64e7-46cf-b32f-c42f447e3c36 req-e2002bae-ca60-4df7-9445-fac9a88c57a3 tempest-SecurityGroupRulesTestJSON-6335183 tempest-SecurityGroupRulesTestJSON-6335183-project-member] Enqueued Resource ID: 5cf319b7-ea66-4b45-a827-d6cbe16e66bf with Priority: HIGHEST for action security_group_rules [ 669.419236] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cf319b7-ea66-4b45-a827-d6cbe16e66bf with Priority: HIGHEST for action security_group_rules [ 669.419545] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5cf319b7-ea66-4b45-a827-d6cbe16e66bf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.419670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5cf319b7-ea66-4b45-a827-d6cbe16e66bf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.419752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5cf319b7-ea66-4b45-a827-d6cbe16e66bf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.420151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5cf319b7-ea66-4b45-a827-d6cbe16e66bf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.421425] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5cf319b7-ea66-4b45-a827-d6cbe16e66bf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.503987] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.504509] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.504509] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.504663] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.504805] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.505103] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.505361] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.505361] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.505489] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.505679] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.505778] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.505908] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.506080] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.506205] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.506302] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.506428] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.529236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.529440] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.529559] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.529727] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.530051] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-8ddf36fc-f88e-4296-a118-16051ba2869e taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.530319] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-8ddf36fc-f88e-4296-a118-16051ba2869e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.530589] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-8ddf36fc-f88e-4296-a118-16051ba2869e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.531347] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-8ddf36fc-f88e-4296-a118-16051ba2869e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.532020] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ddf36fc-f88e-4296-a118-16051ba2869e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.649724] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: SUCCESS [ 669.650058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.948051] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.948051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.948051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.948051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.948051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.948051] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5cf319b7-ea66-4b45-a827-d6cbe16e66bf already deleted. [ 669.948051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5cf319b7-ea66-4b45-a827-d6cbe16e66bf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.035941] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.038211] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.038211] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.038211] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.038211] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.038211] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 8ddf36fc-f88e-4296-a118-16051ba2869e not found, creating... [ 670.038966] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.038966] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.038966] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.039170] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.039311] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.039688] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.039878] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.039989] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.040246] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.040376] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.040534] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 8ddf36fc-f88e-4296-a118-16051ba2869e is going to be created. [ 670.071608] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.071608] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.071941] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.071991] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.072242] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.072727] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-8ddf36fc-f88e-4296-a118-16051ba2869e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.471543] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 in Status: SUCCESS [ 670.471806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.472015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.472269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.472469] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.472593] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.472657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.472809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.472891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.472980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.473085] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.760983] env[65161]: INFO networking_nsxv3.common.synchronization [req-3b54ac4d-0b59-4c1e-8e1e-14aa4797a846 req-a126f738-2df1-42bf-b2eb-da0cbdaeaf12 service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 670.761394] env[65161]: INFO networking_nsxv3.common.synchronization [req-3b54ac4d-0b59-4c1e-8e1e-14aa4797a846 req-a126f738-2df1-42bf-b2eb-da0cbdaeaf12 service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 670.761394] env[65161]: INFO networking_nsxv3.common.synchronization [req-3b54ac4d-0b59-4c1e-8e1e-14aa4797a846 req-a126f738-2df1-42bf-b2eb-da0cbdaeaf12 service nova] Enqueued Resource ID: 8ddf36fc-f88e-4296-a118-16051ba2869e with Priority: HIGHEST for action port [ 670.761884] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 670.762060] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 670.762206] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ddf36fc-f88e-4296-a118-16051ba2869e with Priority: HIGHEST for action port [ 670.762630] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.762630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.762918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.762983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.763063] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.764879] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.764879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.764879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.764879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.764879] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.764879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.765383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.765383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.765383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.765383] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.766242] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ddf36fc-f88e-4296-a118-16051ba2869e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.766242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ddf36fc-f88e-4296-a118-16051ba2869e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.766242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ddf36fc-f88e-4296-a118-16051ba2869e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.766522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ddf36fc-f88e-4296-a118-16051ba2869e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.766522] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ddf36fc-f88e-4296-a118-16051ba2869e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.975548] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.975790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.975790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.976084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.976630] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.976763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.976832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.977143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.977247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.977345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.977509] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.977611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.977675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.977862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.978023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.978121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.978184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.978328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.978405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.978487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.978580] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.268957] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.270520] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.270719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.270999] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ddf36fc-f88e-4296-a118-16051ba2869e with status ACTIVE [ 671.271296] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.271478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.271597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.272051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.273876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.273876] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.273876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.273876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.273876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.273876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.273876] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.273876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.274283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.274544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.274544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.274611] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ddf36fc-f88e-4296-a118-16051ba2869e is going to be updated. [ 671.299598] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.299771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.299840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.300090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.300231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.300401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ddf36fc-f88e-4296-a118-16051ba2869e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.482500] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba07905f-c3ad-48a2-95c0-86b2e0e304c6: rpc.has_security_group_logging(os_id): False [ 671.503688] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.506332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.506332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.506332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.506332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.506332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.506332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.506332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.506332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.506332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.506332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.507168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.512736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.512736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.512736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.512736] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.512736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.512736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.512736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.512736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.512736] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 is going to be created. [ 671.591700] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.591966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.591966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.592273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.592488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.606753] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 in Status: IN_PROGRESS for 2s [ 671.777807] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.282939] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.283166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.283286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.283626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.283677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.283750] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be created. [ 672.325587] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.325785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.325785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.326013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.326187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.336629] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: UNINITIALIZED for 2s [ 672.496873] env[65161]: INFO networking_nsxv3.common.synchronization [req-7de75556-c584-4e0b-850d-9ccd45eb91c9 req-aeeec9c9-2479-4d5b-a843-c9050ed02781 tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 672.497084] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 672.497353] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.497482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.497554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.498357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.498535] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.498649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.498712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.498905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.499016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.499109] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.924555] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ed207e0-4212-452c-98d0-d7f27bb5d375 req-e943716b-9f5d-4024-b6a9-46a8bb788589 tempest-TenantUsagesTestJSON-1931773304 tempest-TenantUsagesTestJSON-1931773304-project-member] Enqueued Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGHEST for action security_group_members [ 672.925166] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGHEST for action security_group_members [ 672.925502] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e081805-9c1f-4f53-b736-a7dddaec90b6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.925687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.925731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.926289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.926289] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.926490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.926490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.926604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.926687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.926789] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.001640] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.001640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.001640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.001640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.001917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.001917] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.002046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.002118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.002507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.002507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.002507] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 673.042842] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.042842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.042842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.043187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.043187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.058687] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 673.210965] env[65161]: INFO networking_nsxv3.common.synchronization [None req-5b0c43b8-2803-45a4-beb7-d701d4655690 None None] Enqueued Resource ID: a0541d1e-76dc-4937-ab65-575d80250bd1 with Priority: HIGHEST for action port [ 673.212184] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0541d1e-76dc-4937-ab65-575d80250bd1 with Priority: HIGHEST for action port [ 673.212520] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0541d1e-76dc-4937-ab65-575d80250bd1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.212671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0541d1e-76dc-4937-ab65-575d80250bd1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.212949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0541d1e-76dc-4937-ab65-575d80250bd1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.213306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0541d1e-76dc-4937-ab65-575d80250bd1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.213401] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0541d1e-76dc-4937-ab65-575d80250bd1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.429186] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.429354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.429470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.429647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.429739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.429929] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.430045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.430111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.430277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.430353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.430438] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 already deleted. [ 673.430519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.621333] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 in Status: SUCCESS [ 673.621653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.718938] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0541d1e-76dc-4937-ab65-575d80250bd1 [ 673.719213] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.719355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.719417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.719628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.719736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.719808] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0541d1e-76dc-4937-ab65-575d80250bd1 already deleted. [ 673.719884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0541d1e-76dc-4937-ab65-575d80250bd1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.104509] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.105064] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.105064] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.105149] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.105409] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.105564] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.105679] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.105892] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.106041] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.106253] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.106371] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.106457] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.106559] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.106659] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.106756] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.107330] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.130661] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.130661] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.130861] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.130957] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.131303] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.131528] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.131586] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.131882] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.132236] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.347715] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 674.347715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.347715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.347715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.347715] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.348175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.348542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.348846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.351387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.352026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.352026] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.497493] env[65161]: INFO networking_nsxv3.common.synchronization [None req-bafaec71-9ebc-4b41-b12c-5c8310ccfc0d None None] Enqueued Resource ID: deea8f7d-d855-416f-a630-2234c26cbd01 with Priority: HIGHEST for action port [ 674.498017] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deea8f7d-d855-416f-a630-2234c26cbd01 with Priority: HIGHEST for action port [ 674.498331] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-deea8f7d-d855-416f-a630-2234c26cbd01 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.498467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deea8f7d-d855-416f-a630-2234c26cbd01" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.498545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deea8f7d-d855-416f-a630-2234c26cbd01" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.498767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deea8f7d-d855-416f-a630-2234c26cbd01" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.498853] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deea8f7d-d855-416f-a630-2234c26cbd01',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.638058] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.638058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.638058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.638058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.638058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.638058] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7 not found, creating... [ 674.638058] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.638058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.638058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.638058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.638058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.638553] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.638553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.638553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.638794] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.639123] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.639415] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7 is going to be created. [ 674.666256] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.666256] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.666256] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.666256] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.666256] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.666256] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.855171] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.855427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.855564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.855904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.856198] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.856369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.856478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.856712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.856825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.856940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.857161] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.857279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.857349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.857515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.857659] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.857794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.858807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.858807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.858807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.858807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.858807] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.996992] env[65161]: INFO networking_nsxv3.common.synchronization [None req-b7760335-ed57-4429-a1c3-0fece7c00a60 None None] Enqueued Resource ID: 2f354096-397f-4638-a697-6be8232d367a with Priority: HIGHEST for action port [ 674.997589] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f354096-397f-4638-a697-6be8232d367a with Priority: HIGHEST for action port [ 674.997908] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f354096-397f-4638-a697-6be8232d367a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.998055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f354096-397f-4638-a697-6be8232d367a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.998122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f354096-397f-4638-a697-6be8232d367a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.998383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f354096-397f-4638-a697-6be8232d367a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.998478] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f354096-397f-4638-a697-6be8232d367a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.001341] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deea8f7d-d855-416f-a630-2234c26cbd01 [ 675.001527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.001644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.001708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.001899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.002227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.002227] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deea8f7d-d855-416f-a630-2234c26cbd01 already deleted. [ 675.002227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deea8f7d-d855-416f-a630-2234c26cbd01" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.070034] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 675.070229] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b deletion is rescheduled due to dependency. [ 675.070229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.361605] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 490d862d-f7b2-497d-912a-e1801d9b16ad: rpc.has_security_group_logging(os_id): False [ 675.380496] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.380676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.380723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.381167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.381167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.381342] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.381342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.381426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.381551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.381624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.381800] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.381896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.381958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.382115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.382188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.385746] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.385746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.385746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.385746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.385746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.385746] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be created. [ 675.418149] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ed207e0-4212-452c-98d0-d7f27bb5d375 req-3428d32c-ebea-4cf7-8665-ebe1f4645f77 service nova] Enqueued Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGHEST for action security_group_rules [ 675.418461] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ed207e0-4212-452c-98d0-d7f27bb5d375 req-3428d32c-ebea-4cf7-8665-ebe1f4645f77 service nova] Enqueued Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGHEST for action security_group_members [ 675.418461] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ed207e0-4212-452c-98d0-d7f27bb5d375 req-3428d32c-ebea-4cf7-8665-ebe1f4645f77 service nova] Enqueued Resource ID: db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7 with Priority: HIGHEST for action port [ 675.419500] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGHEST for action security_group_rules [ 675.419500] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGHEST for action security_group_members [ 675.420039] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7 with Priority: HIGHEST for action port [ 675.420039] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e081805-9c1f-4f53-b736-a7dddaec90b6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.420039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.420039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.424096] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.424096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e081805-9c1f-4f53-b736-a7dddaec90b6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.424096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.424096] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.424096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.424096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.424096] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.455016] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.455193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.455263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.455472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.455650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.472816] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 675.502377] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f354096-397f-4638-a697-6be8232d367a [ 675.503028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.503028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.503028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.503028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.503319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.503319] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f354096-397f-4638-a697-6be8232d367a already deleted. [ 675.503319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f354096-397f-4638-a697-6be8232d367a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.929395] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.929395] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e081805-9c1f-4f53-b736-a7dddaec90b6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.929395] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7 with status ACTIVE [ 675.929395] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.929395] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.929395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.934236] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.934236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.934236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.934236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.934236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.934236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7 is going to be updated. [ 675.964413] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.964571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.964571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.964753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.964889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.965163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db2b17d9-178b-414c-b0c3-b2ee3f6ccdd7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.441881] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.946906] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.946906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.946906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.946906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.946906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.946906] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 is going to be created. [ 676.976036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.976894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.976894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.977531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.977531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.989396] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 in Status: UNINITIALIZED for 2s [ 677.488879] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 677.488879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.510537] env[65161]: INFO networking_nsxv3.common.synchronization [None req-0294d1ec-03b1-4c21-81f3-b472813ea30c None None] Enqueued Resource ID: 1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22 with Priority: HIGHEST for action port [ 677.510537] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22 with Priority: HIGHEST for action port [ 677.511322] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.511322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.511322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.511322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.511322] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.014024] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22 [ 678.014320] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.014476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.014545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.014765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.014855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.014951] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22 already deleted. [ 678.015046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e2f9e22-68bb-4ee1-bf80-2e5dd1528a22" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.999200] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 in Status: SUCCESS [ 679.000279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.000279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.000441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.001034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.001034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.001034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.001034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.001034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.001287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.001287] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.053606] env[65161]: INFO networking_nsxv3.common.synchronization [None req-edfac948-65ba-4822-bf7b-c2df57810d01 tempest-ServersTestManualDisk-1978629773 tempest-ServersTestManualDisk-1978629773-project-member] Enqueued Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_rules [ 679.054602] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_rules [ 679.054602] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc716056-e80f-437c-a978-42b0cd24b9c7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.054602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.054602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.054899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.054899] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.187068] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c353bdba-7ee4-45ea-9382-efb6fc168104 tempest-ServersTestManualDisk-1978629773 tempest-ServersTestManualDisk-1978629773-project-member] Enqueued Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_rules [ 679.187628] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_rules [ 679.187968] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc716056-e80f-437c-a978-42b0cd24b9c7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.188083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.456180] env[65161]: INFO networking_nsxv3.common.synchronization [req-646e5884-7392-46d1-bf29-8cabd7ed0971 req-3f3891e8-9f5a-4d0e-94e8-72184189d06a tempest-ServersTestBootFromVolume-330207307 tempest-ServersTestBootFromVolume-330207307-project-member] Enqueued Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_members [ 679.456543] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_members [ 679.456843] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd8909e-2253-4a61-b63b-9d668d108bb9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.457091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.457242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.457548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.458025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.458025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.458173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.458574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.458718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.458878] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.503260] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e081805-9c1f-4f53-b736-a7dddaec90b6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.503430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.503521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.503741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.503909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.504023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.504097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.504227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.504316] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.504441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.504894] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e081805-9c1f-4f53-b736-a7dddaec90b6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.504894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.504894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.505064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.505145] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.505238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.505297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.505430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.505503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.505582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.505719] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.581565] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.581565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.581565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.581565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.581565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.581565] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc716056-e80f-437c-a978-42b0cd24b9c7 already deleted. [ 679.581565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.581565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.581565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.581565] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.695950] env[65161]: INFO networking_nsxv3.common.synchronization [None req-a40d78c6-fdc8-43c4-9129-eb027409172c None None] Enqueued Resource ID: 14c177ea-e95f-4b42-b931-c1e70d2a347c with Priority: HIGHEST for action port [ 679.696318] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c177ea-e95f-4b42-b931-c1e70d2a347c with Priority: HIGHEST for action port [ 679.696900] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-14c177ea-e95f-4b42-b931-c1e70d2a347c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.696900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14c177ea-e95f-4b42-b931-c1e70d2a347c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.696900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14c177ea-e95f-4b42-b931-c1e70d2a347c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.697198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14c177ea-e95f-4b42-b931-c1e70d2a347c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.697424] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c177ea-e95f-4b42-b931-c1e70d2a347c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.963651] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.963651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.963651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.963651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.963651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.963651] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.963651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.963651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.964350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.964543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.964724] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 already deleted. [ 679.965311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.009656] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e081805-9c1f-4f53-b736-a7dddaec90b6: rpc.has_security_group_logging(os_id): False [ 680.046631] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.046771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.046908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.047187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.047849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.047849] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.047849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.047849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.048147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.048147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.048390] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.050312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.050705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.050705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.051096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.051182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.051296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.051360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.051551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.051699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.051783] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 is going to be created. [ 680.123472] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.123696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.123869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.125157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.125157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.125157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc716056-e80f-437c-a978-42b0cd24b9c7 already deleted. [ 680.125157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.167064] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.167297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.167297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.167567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.167684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.186645] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 in Status: IN_PROGRESS for 2s [ 680.200255] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14c177ea-e95f-4b42-b931-c1e70d2a347c [ 680.200511] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.200645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.200714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.203537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.203731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.203895] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14c177ea-e95f-4b42-b931-c1e70d2a347c already deleted. [ 680.204026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14c177ea-e95f-4b42-b931-c1e70d2a347c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.412713] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-478 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.413213] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-478" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.414273] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-478" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.414610] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-478" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.415228] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.415482] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.415569] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.416720] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.416925] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.417230] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.417398] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.417678] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.417678] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.418548] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.418548] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.418548] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.441283] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.442054] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.442054] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.442054] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-478" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.442321] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.442321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.442516] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.443709] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.443709] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17f1ddc2-428b-4d57-b56f-19a81c44ac6d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.945511] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.945748] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.945792] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.946165] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.946261] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.946394] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 17f1ddc2-428b-4d57-b56f-19a81c44ac6d not found, creating... [ 680.946739] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.946838] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.946948] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.947247] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.947422] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.947718] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.948469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.948469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.948469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.948469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.948469] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 17f1ddc2-428b-4d57-b56f-19a81c44ac6d is going to be created. [ 680.987547] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.987891] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.987966] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.988309] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.988599] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.988837] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.700462] env[65161]: INFO networking_nsxv3.common.synchronization [req-646e5884-7392-46d1-bf29-8cabd7ed0971 req-254cd17b-d3cb-4ab3-827b-a97d00de51ca service nova] Enqueued Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_rules [ 681.700462] env[65161]: INFO networking_nsxv3.common.synchronization [req-646e5884-7392-46d1-bf29-8cabd7ed0971 req-254cd17b-d3cb-4ab3-827b-a97d00de51ca service nova] Enqueued Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_members [ 681.700462] env[65161]: INFO networking_nsxv3.common.synchronization [req-646e5884-7392-46d1-bf29-8cabd7ed0971 req-254cd17b-d3cb-4ab3-827b-a97d00de51ca service nova] Enqueued Resource ID: 17f1ddc2-428b-4d57-b56f-19a81c44ac6d with Priority: HIGHEST for action port [ 681.700462] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_rules [ 681.700462] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_members [ 681.700462] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f1ddc2-428b-4d57-b56f-19a81c44ac6d with Priority: HIGHEST for action port [ 681.700462] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd8909e-2253-4a61-b63b-9d668d108bb9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.700462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.700462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.703218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.704408] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.708769] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd8909e-2253-4a61-b63b-9d668d108bb9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.709055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.709552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.710420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.710510] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.710582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.710641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.710796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.710904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.711031] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.712777] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.712777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.712777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.712971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.712971] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17f1ddc2-428b-4d57-b56f-19a81c44ac6d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.199959] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 in Status: SUCCESS [ 682.199959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.210793] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd8909e-2253-4a61-b63b-9d668d108bb9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.210793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.214427] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.215436] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17f1ddc2-428b-4d57-b56f-19a81c44ac6d with status ACTIVE [ 682.215659] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.215816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.215927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.216404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.216404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.216637] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.216785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.216883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.217378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.217524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.217801] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.217948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.218071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.218290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.218401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.218525] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17f1ddc2-428b-4d57-b56f-19a81c44ac6d is going to be updated. [ 682.245024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.245217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.245260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.245456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.245718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.245791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17f1ddc2-428b-4d57-b56f-19a81c44ac6d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.312080] env[65161]: INFO networking_nsxv3.common.synchronization [None req-441c2367-c30e-4bed-ad43-e9d4a31fe6fd None None] Enqueued Resource ID: 30587005-c2de-483d-b064-bf17ab671c21 with Priority: HIGHEST for action port [ 682.312627] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30587005-c2de-483d-b064-bf17ab671c21 with Priority: HIGHEST for action port [ 682.313366] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-30587005-c2de-483d-b064-bf17ab671c21 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.313366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30587005-c2de-483d-b064-bf17ab671c21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.313366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30587005-c2de-483d-b064-bf17ab671c21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.313765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30587005-c2de-483d-b064-bf17ab671c21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.313911] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30587005-c2de-483d-b064-bf17ab671c21',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.617613] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1c7796d-6b50-4b6c-9599-9398845f3dbe req-d8302934-713d-4280-966e-f38927f7320b tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 682.618417] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 682.618954] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.619430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.619430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.619563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.619733] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.619847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.619914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.620130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.620222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.620327] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.721466] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.817368] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30587005-c2de-483d-b064-bf17ab671c21 [ 682.817751] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.817948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.818079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.818342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.818430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.818691] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30587005-c2de-483d-b064-bf17ab671c21 already deleted. [ 682.818691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30587005-c2de-483d-b064-bf17ab671c21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.058955] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.059190] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.059304] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.059556] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.059795] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.059941] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.061180] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.061180] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.062195] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.062994] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.062994] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.062994] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.062994] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.062994] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.062994] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.063422] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.086309] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.086515] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.086633] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.086807] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.087129] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.087302] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.087419] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.087789] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.087937] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.123583] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.123886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.124764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.124764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.124764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.124764] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.124764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.124764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.125092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.125092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.125218] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda already deleted. [ 683.125341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.287779] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.287921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.287983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.288226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.288315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.288416] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 is going to be created. [ 683.326721] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.326818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.327584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.327584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.327584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.339193] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 in Status: UNINITIALIZED for 2s [ 683.591621] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.591945] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.592127] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.592504] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.592718] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.592915] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79 not found, creating... [ 683.593364] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.593606] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.593763] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.595249] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.595572] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.595958] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.596144] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.596289] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.596583] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.596749] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.596894] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79 is going to be created. [ 683.623845] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.624240] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.624448] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.624757] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.625107] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.625357] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.321122] env[65161]: INFO networking_nsxv3.common.synchronization [req-7e31b92f-bf85-4a54-a4a7-757fec5b5b53 req-4aed4ee8-f765-4415-883c-9308b9a10377 tempest-ServerDiagnosticsTest-860235650 tempest-ServerDiagnosticsTest-860235650-project-member] Enqueued Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGHEST for action security_group_members [ 684.321804] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGHEST for action security_group_members [ 684.322576] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.322576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.322576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.322576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.322805] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.322805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.322894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.322971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.323070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.323174] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.430175] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1c7796d-6b50-4b6c-9599-9398845f3dbe req-be9817ba-1ec1-4287-bdf8-a5721cce2fed service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 684.430175] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1c7796d-6b50-4b6c-9599-9398845f3dbe req-be9817ba-1ec1-4287-bdf8-a5721cce2fed service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 684.430175] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1c7796d-6b50-4b6c-9599-9398845f3dbe req-be9817ba-1ec1-4287-bdf8-a5721cce2fed service nova] Enqueued Resource ID: 1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79 with Priority: HIGHEST for action port [ 684.430175] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 684.430175] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 684.430175] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79 with Priority: HIGHEST for action port [ 684.430175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.430885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.432071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.432420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.432608] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.434400] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.440145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.440145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.440145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.440145] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.440145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.440145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.440145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.440145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.440145] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.442766] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.442766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.442766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.442766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.442766] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.694581] env[65161]: INFO networking_nsxv3.common.synchronization [None req-008a4791-7de8-41e8-bd15-2987b5ceebb5 tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 684.695525] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 684.695525] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.695865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.695865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.697535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.697709] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.812788] env[65161]: INFO networking_nsxv3.common.synchronization [None req-5c969b8a-fedc-47b2-915a-ed73df62cdfd tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 684.813580] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 684.813955] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.814078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.826693] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.826796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.826870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.827381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.827381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.827586] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.827586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.827586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.827744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.827819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.827902] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f is going to be updated. [ 684.864126] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.864428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.864428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.864730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.864818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.880461] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f in Status: IN_PROGRESS for 2s [ 684.944040] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.944040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.944481] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.945461] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79 with status ACTIVE [ 684.945627] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.946499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.946499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.946499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.946499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.946499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.946946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.946946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.946946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.946946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.947122] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.947180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.947219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.947347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.947420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.947525] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79 is going to be updated. [ 684.980035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.981058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.981058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.981058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.981058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.981311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f8b9851-2e93-45b3-9bb1-9a2a8c5a0a79" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.034507] env[65161]: INFO networking_nsxv3.common.synchronization [req-5a7ca373-8277-4695-86d4-9e0a0232af21 req-2279381b-91d0-4615-9434-2ef8f9a82583 tempest-SecurityGroupRulesTestJSON-6335183 tempest-SecurityGroupRulesTestJSON-6335183-project-member] Enqueued Resource ID: a7f5fc52-76c2-4f7c-8aab-36a39b8879f3 with Priority: HIGHEST for action security_group_rules [ 685.035093] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7f5fc52-76c2-4f7c-8aab-36a39b8879f3 with Priority: HIGHEST for action security_group_rules [ 685.036292] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7f5fc52-76c2-4f7c-8aab-36a39b8879f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.036292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7f5fc52-76c2-4f7c-8aab-36a39b8879f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.036292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7f5fc52-76c2-4f7c-8aab-36a39b8879f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.036292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7f5fc52-76c2-4f7c-8aab-36a39b8879f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.036292] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7f5fc52-76c2-4f7c-8aab-36a39b8879f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.239250] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.239491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.239611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.239870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.239961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.240113] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 already deleted. [ 685.240260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.240511] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.240815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.240956] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.354794] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 in Status: SUCCESS [ 685.355076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.355217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.355466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.355612] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.355770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.355825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.356038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.356166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.357703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.357703] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.450648] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.566930] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.566930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.566930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.566930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.566930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.566930] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7f5fc52-76c2-4f7c-8aab-36a39b8879f3 already deleted. [ 685.566930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7f5fc52-76c2-4f7c-8aab-36a39b8879f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.767163] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.767329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.767379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.767587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.767678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.767787] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 already deleted. [ 685.767851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.861545] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.955034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.955208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.955752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.955752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.955752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.955931] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be created. [ 685.985878] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.986875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.986875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.986875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.986875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.003491] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: UNINITIALIZED for 2s [ 686.365333] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cd8909e-2253-4a61-b63b-9d668d108bb9: rpc.has_security_group_logging(os_id): False [ 686.392120] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.392120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.392120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.392120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.392120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.392120] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.392120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.392120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.392120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.392120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.392120] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 is going to be created. [ 686.484029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.484029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.484029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.484029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.484029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.503958] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 in Status: IN_PROGRESS for 2s [ 686.898418] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f in Status: SUCCESS [ 686.898977] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f deletion is rescheduled due to dependency. [ 686.899664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.854044] env[65161]: INFO networking_nsxv3.common.synchronization [None req-f4e54315-f4e7-4f4c-81f9-aa3aeb17f3dd None None] Enqueued Resource ID: 9e9ad0b5-bfe1-42d3-ab75-1bded892505f with Priority: HIGHEST for action port [ 687.854044] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e9ad0b5-bfe1-42d3-ab75-1bded892505f with Priority: HIGHEST for action port [ 687.854361] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e9ad0b5-bfe1-42d3-ab75-1bded892505f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.855224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e9ad0b5-bfe1-42d3-ab75-1bded892505f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.855224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e9ad0b5-bfe1-42d3-ab75-1bded892505f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.855224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e9ad0b5-bfe1-42d3-ab75-1bded892505f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.855224] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e9ad0b5-bfe1-42d3-ab75-1bded892505f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.014873] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 688.014873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.014873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.015238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.015238] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.015344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.015385] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.016060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.016060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.016060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.016060] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.359270] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e9ad0b5-bfe1-42d3-ab75-1bded892505f [ 688.359270] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.359270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.359270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.359270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.359270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.359270] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e9ad0b5-bfe1-42d3-ab75-1bded892505f already deleted. [ 688.359270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e9ad0b5-bfe1-42d3-ab75-1bded892505f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.517528] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 in Status: SUCCESS [ 688.517819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.519475] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.519824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.519824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.520158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.520348] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.520491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.520579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.520806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.520916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.521025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.521330] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.521423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.521480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.521671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.521863] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.521974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.522062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.522379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.522601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.522754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.522873] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.630068] env[65161]: INFO networking_nsxv3.common.synchronization [req-40aec577-0b65-4371-b2ad-bd8509a48ec1 req-2c36c57a-bf71-429a-842e-a234a83e08bc tempest-DeleteServersAdminTestJSON-344791916 tempest-DeleteServersAdminTestJSON-344791916-project-member] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 688.630068] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGHEST for action security_group_members [ 688.630068] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.631355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.631498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.631630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.631836] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.631929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.631982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.632142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.632231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.632312] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.025372] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 200ba9e0-f56c-4b5d-9e39-69a507140fda: rpc.has_security_group_logging(os_id): False [ 689.058627] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.058787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.058861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.059167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.059293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.059457] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.059557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.059620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.059783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.059859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.060072] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.060170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.060231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.060372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.060456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.060622] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.060714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.060818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.061030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.061668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.061668] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be created. [ 689.065606] env[65161]: INFO networking_nsxv3.common.synchronization [req-4804c84c-96f8-4e85-a862-1cdf25598fac req-e2e62292-d539-4945-91b8-3d517bd4c825 tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 689.066214] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 689.066539] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.066760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.066760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.066877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.067023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.067335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.067403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.067584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.067685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.067782] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.136120] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.136120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.136287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.136393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.136498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.136721] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.136823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.136886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.137298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.137298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.137298] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 is going to be updated. [ 689.139863] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.139863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.139863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.139863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.139863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.162022] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 689.178526] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.178526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.178526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.179027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.179066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.207822] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: IN_PROGRESS for 2s [ 689.468857] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.469236] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.469346] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.469568] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.469828] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.469974] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.470675] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.470675] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.470675] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.470886] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.470991] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.471184] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.471274] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.471376] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.471472] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.471596] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.491355] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.491526] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.491656] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.491820] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.492220] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.492391] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.492502] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.493091] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.493091] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.574024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.574024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.574024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.574024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.574024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.574024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.574024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.574024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.574024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.574024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.574024] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 689.600433] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.600673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.600760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.600975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.601182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.611096] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 689.995166] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.995501] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.995659] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.996408] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.996570] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.996725] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca not found, creating... [ 689.996987] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.997179] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.997282] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.997511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.997708] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.998015] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.998525] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.998677] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.998983] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.999217] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.999387] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca is going to be created. [ 690.021624] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.021929] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.022125] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.022425] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.022650] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.022892] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.121186] env[65161]: INFO networking_nsxv3.common.synchronization [None req-913fad71-f4d8-42ea-b51a-8fab469f65da None None] Enqueued Resource ID: 0ae044da-670a-4976-a612-c2554c936bde with Priority: HIGHEST for action port [ 690.121607] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae044da-670a-4976-a612-c2554c936bde with Priority: HIGHEST for action port [ 690.121870] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ae044da-670a-4976-a612-c2554c936bde taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.122098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ae044da-670a-4976-a612-c2554c936bde" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.122192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ae044da-670a-4976-a612-c2554c936bde" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.122518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ae044da-670a-4976-a612-c2554c936bde" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.122636] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ae044da-670a-4976-a612-c2554c936bde',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.624258] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ae044da-670a-4976-a612-c2554c936bde [ 690.624499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.624620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.624689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.624919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.625023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.625109] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ae044da-670a-4976-a612-c2554c936bde already deleted. [ 690.625182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ae044da-670a-4976-a612-c2554c936bde" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.744904] env[65161]: INFO networking_nsxv3.common.synchronization [req-4804c84c-96f8-4e85-a862-1cdf25598fac req-8b48bbf8-d567-49f1-97ae-80ac022260ba service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 690.745741] env[65161]: INFO networking_nsxv3.common.synchronization [req-4804c84c-96f8-4e85-a862-1cdf25598fac req-8b48bbf8-d567-49f1-97ae-80ac022260ba service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 690.745741] env[65161]: INFO networking_nsxv3.common.synchronization [req-4804c84c-96f8-4e85-a862-1cdf25598fac req-8b48bbf8-d567-49f1-97ae-80ac022260ba service nova] Enqueued Resource ID: cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca with Priority: HIGHEST for action port [ 690.745741] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 690.745741] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 690.745741] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca with Priority: HIGHEST for action port [ 690.747266] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.747266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.747266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.747266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.747266] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.748201] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.748308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.748506] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.748674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.748674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.748835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.748926] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.173408] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 691.173742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.218121] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 in Status: SUCCESS [ 691.218405] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 deletion is rescheduled due to dependency. [ 691.218493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.252762] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.252762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.252762] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca with status ACTIVE [ 691.252762] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.252762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.253162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.253162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.253162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.253275] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.253668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.253668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.253668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.253668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.254375] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.254375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.254375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.254375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.254375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.254375] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca is going to be updated. [ 691.277225] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.277225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.277225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.277429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.277580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.277819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdc8d69b-a359-4fd6-b2a5-548d3f3d0fca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.366716] env[65161]: INFO networking_nsxv3.common.synchronization [None req-398d9484-b77b-41dd-83fe-c30c870f1e4c None None] Enqueued Resource ID: 6a888b95-9cc2-4a62-b731-7c628a2d7042 with Priority: HIGHEST for action port [ 691.368527] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a888b95-9cc2-4a62-b731-7c628a2d7042 with Priority: HIGHEST for action port [ 691.368897] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a888b95-9cc2-4a62-b731-7c628a2d7042 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.369040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a888b95-9cc2-4a62-b731-7c628a2d7042" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.369142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a888b95-9cc2-4a62-b731-7c628a2d7042" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.369450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a888b95-9cc2-4a62-b731-7c628a2d7042" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.370146] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a888b95-9cc2-4a62-b731-7c628a2d7042',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.550728] env[65161]: INFO networking_nsxv3.common.synchronization [req-9cd88f03-e445-4791-af33-cda48dea608d req-d10d3768-4832-48f5-9e9d-e9eaf72d04d6 tempest-ServersAdminTestJSON-2133010713 tempest-ServersAdminTestJSON-2133010713-project-member] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 691.551362] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 691.551759] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.551922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.552010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.553843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.554867] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.555569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.555657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.555880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.556188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.556355] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.622260] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 691.622482] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b deletion is rescheduled due to dependency. [ 691.622579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.622712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.622926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.623122] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.623246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.623303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.623443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.623523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.623619] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.872953] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a888b95-9cc2-4a62-b731-7c628a2d7042 [ 691.872953] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.873213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.873213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.873404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.873483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.873584] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a888b95-9cc2-4a62-b731-7c628a2d7042 already deleted. [ 691.873664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a888b95-9cc2-4a62-b731-7c628a2d7042" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.045645] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-741 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.045839] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.045962] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.046263] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.046527] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.046682] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.046803] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.050055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.050248] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.050476] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.050592] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.050704] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.050815] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.050918] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.051031] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.051213] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.059400] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.074921] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.075042] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.075318] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.075502] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-741" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.076105] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-0128a628-c6cf-4346-93c3-bfafffcd8c43 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.076250] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-0128a628-c6cf-4346-93c3-bfafffcd8c43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.076703] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-0128a628-c6cf-4346-93c3-bfafffcd8c43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.076847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-0128a628-c6cf-4346-93c3-bfafffcd8c43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.077385] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0128a628-c6cf-4346-93c3-bfafffcd8c43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.125484] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.564029] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.580362] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.583018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.583018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.583018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.583018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.583018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 0128a628-c6cf-4346-93c3-bfafffcd8c43 not found, creating... [ 692.583018] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.583018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.583018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.583018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.583018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.583487] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.583487] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.583487] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.583487] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.584123] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.584625] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 0128a628-c6cf-4346-93c3-bfafffcd8c43 is going to be created. [ 692.607903] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.608158] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.608237] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.608993] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.609367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.609582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-0128a628-c6cf-4346-93c3-bfafffcd8c43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.630393] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.065581] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.066414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.066414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.066414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.066414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.066414] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 693.099674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.099841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.099890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.101445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.101445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.112364] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 693.136808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.140915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.140915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.140915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.140915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.140915] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 693.168680] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.168812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.168893] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.169230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.169404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.178620] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 693.343822] env[65161]: INFO networking_nsxv3.common.synchronization [req-9cd88f03-e445-4791-af33-cda48dea608d req-9b635419-9858-4693-9604-81fdc932efc0 service nova] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_rules [ 693.344031] env[65161]: INFO networking_nsxv3.common.synchronization [req-9cd88f03-e445-4791-af33-cda48dea608d req-9b635419-9858-4693-9604-81fdc932efc0 service nova] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 693.344031] env[65161]: INFO networking_nsxv3.common.synchronization [req-9cd88f03-e445-4791-af33-cda48dea608d req-9b635419-9858-4693-9604-81fdc932efc0 service nova] Enqueued Resource ID: 0128a628-c6cf-4346-93c3-bfafffcd8c43 with Priority: HIGHEST for action port [ 693.346878] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_rules [ 693.346878] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 693.346878] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0128a628-c6cf-4346-93c3-bfafffcd8c43 with Priority: HIGHEST for action port [ 693.346878] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.346878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.346878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.346878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.346878] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.347491] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.347491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.347577] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0128a628-c6cf-4346-93c3-bfafffcd8c43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.347700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0128a628-c6cf-4346-93c3-bfafffcd8c43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.347741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0128a628-c6cf-4346-93c3-bfafffcd8c43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.347942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0128a628-c6cf-4346-93c3-bfafffcd8c43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.348024] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0128a628-c6cf-4346-93c3-bfafffcd8c43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.851341] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.851749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.851749] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0128a628-c6cf-4346-93c3-bfafffcd8c43 with status ACTIVE [ 693.851887] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.851969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.852419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.852648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.852702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.852967] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.852967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.853163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.853226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.853292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.853471] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.853592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.853861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.853861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.853861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.856851] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0128a628-c6cf-4346-93c3-bfafffcd8c43 is going to be updated. [ 693.887211] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.887352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.888269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.888269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.888269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.888269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0128a628-c6cf-4346-93c3-bfafffcd8c43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.105296] env[65161]: INFO networking_nsxv3.common.synchronization [None req-4037b488-34e3-42e6-bc69-7bca5a3a4f23 None None] Enqueued Resource ID: 7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7 with Priority: HIGHEST for action port [ 694.105296] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7 with Priority: HIGHEST for action port [ 694.105296] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.105296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.105296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.105296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.105296] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.261942] env[65161]: INFO networking_nsxv3.common.synchronization [req-68d3c294-ca1c-4e99-b10d-66a3b69d1f66 req-2a9a49b2-905b-413e-afae-cc58af885082 tempest-FloatingIPsAssociationTestJSON-2068989689 tempest-FloatingIPsAssociationTestJSON-2068989689-project-member] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 694.262546] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 694.262838] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.262957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.263042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.263300] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.263458] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.263560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.263623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.263771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.263853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.263945] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.610094] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7 [ 694.610955] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.611078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.611168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.611436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.611580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.611701] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7 already deleted. [ 694.611888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ff2bc37-3fe4-4857-a97a-3bf7ed41e8b7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.627798] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.627992] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.629072] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.629072] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.629072] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.629072] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.629439] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.629439] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.629638] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.629840] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.629941] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.630096] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.630159] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.630240] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.630335] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.630454] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.652688] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.652688] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 694.653244] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.653244] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.653244] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-a01eeafa-20b3-45d5-9d36-d495807e56c0 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.653535] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-a01eeafa-20b3-45d5-9d36-d495807e56c0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.653535] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-a01eeafa-20b3-45d5-9d36-d495807e56c0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.654031] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-a01eeafa-20b3-45d5-9d36-d495807e56c0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.654031] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a01eeafa-20b3-45d5-9d36-d495807e56c0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.765762] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.765914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.765984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.766225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.766320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.766520] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.766627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.766673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.766819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.766991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.766991] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 already deleted. [ 694.767117] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.123043] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 695.123545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.123648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.123887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.124063] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.124178] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.124259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.124400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.124485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.124578] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.155832] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.156052] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.156186] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.156452] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.156592] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.156740] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port a01eeafa-20b3-45d5-9d36-d495807e56c0 not found, creating... [ 695.156989] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.157171] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.157344] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.157647] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.157858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.158371] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.158541] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.158725] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.158945] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.159116] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.159256] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: a01eeafa-20b3-45d5-9d36-d495807e56c0 is going to be created. [ 695.183853] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.184107] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.184248] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.184539] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.184774] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.185022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-a01eeafa-20b3-45d5-9d36-d495807e56c0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.189206] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 695.189402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.189549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.189750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.189935] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.190059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.190123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.190279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.190361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.190446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.190537] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.628888] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.693202] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.693202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.693202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.693202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.693385] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.693438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.693481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.693609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.693689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.693771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.693906] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.693991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.694062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.694196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.694325] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.694455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.694455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.694585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.694656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.694734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.694818] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.904692] env[65161]: INFO networking_nsxv3.common.synchronization [req-68d3c294-ca1c-4e99-b10d-66a3b69d1f66 req-a3d33359-5d11-4d5d-b266-9d5d2357e4ea service nova] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_rules [ 695.904864] env[65161]: INFO networking_nsxv3.common.synchronization [req-68d3c294-ca1c-4e99-b10d-66a3b69d1f66 req-a3d33359-5d11-4d5d-b266-9d5d2357e4ea service nova] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 695.904988] env[65161]: INFO networking_nsxv3.common.synchronization [req-68d3c294-ca1c-4e99-b10d-66a3b69d1f66 req-a3d33359-5d11-4d5d-b266-9d5d2357e4ea service nova] Enqueued Resource ID: a01eeafa-20b3-45d5-9d36-d495807e56c0 with Priority: HIGHEST for action port [ 695.905660] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_rules [ 695.906253] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 695.906253] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a01eeafa-20b3-45d5-9d36-d495807e56c0 with Priority: HIGHEST for action port [ 695.906377] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.907025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.907025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.907025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.907295] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.908877] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.908877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.908877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.908877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.908877] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.908877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.909231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.909231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.909830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.909830] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.911022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a01eeafa-20b3-45d5-9d36-d495807e56c0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.911022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a01eeafa-20b3-45d5-9d36-d495807e56c0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.911022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a01eeafa-20b3-45d5-9d36-d495807e56c0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.911022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a01eeafa-20b3-45d5-9d36-d495807e56c0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.911022] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a01eeafa-20b3-45d5-9d36-d495807e56c0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.129724] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.196962] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68ff1a7f-59cd-4081-9af0-9322734ba92b: rpc.has_security_group_logging(os_id): False [ 696.221038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.221038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.221038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.221038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.221038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.221038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.221038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.221038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.221038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.221038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.221642] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.221642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.221642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.221642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.222093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.222093] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.222093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.222093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.222273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.222372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.222467] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 696.299738] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.299738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.299738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.299972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.299972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.315455] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 696.414046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.414046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.414046] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.414975] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a01eeafa-20b3-45d5-9d36-d495807e56c0 with status ACTIVE [ 696.415143] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.415263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.415331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.415532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.418814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.418814] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.418814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.418814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.418814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.418814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.418814] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.418814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.418814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.419318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.419318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.419318] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a01eeafa-20b3-45d5-9d36-d495807e56c0 is going to be updated. [ 696.442434] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.442434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.442434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.445065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.445065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.445065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a01eeafa-20b3-45d5-9d36-d495807e56c0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.575940] env[65161]: INFO networking_nsxv3.common.synchronization [req-800a7a5f-e675-4263-884d-d441c948cb2b req-88ca7267-ba07-49dd-9714-033e3f7f12f5 tempest-InstanceActionsNegativeTestJSON-996522854 tempest-InstanceActionsNegativeTestJSON-996522854-project-member] Enqueued Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGHEST for action security_group_members [ 696.578867] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGHEST for action security_group_members [ 696.579782] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.579931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.579995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.580263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.580411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.580542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.580691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.580828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.580997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.581246] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.633155] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.633314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.633375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.633685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.633724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.633819] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 696.665570] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.665570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.665813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.665853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.666030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.689771] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 696.921776] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.084773] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.084773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.084773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.085135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.085135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.085279] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.085438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.085438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.085996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.086111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.086192] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 is going to be updated. [ 697.121041] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.121041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.121041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.121041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.121342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.131808] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 in Status: IN_PROGRESS for 2s [ 697.426350] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.426499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.426573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.428564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.428564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.428564] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 is going to be created. [ 697.452537] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.452646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.452851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.453049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.453162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.463431] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: UNINITIALIZED for 2s [ 697.815716] env[65161]: INFO networking_nsxv3.common.synchronization [req-54352462-2121-48b4-82ee-74eaebaa33f4 req-985b6d03-b023-4705-b8e1-7cbe334778b2 tempest-SecurityGroupRulesTestJSON-6335183 tempest-SecurityGroupRulesTestJSON-6335183-project-member] Enqueued Resource ID: a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda with Priority: HIGHEST for action security_group_rules [ 697.816769] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda with Priority: HIGHEST for action security_group_rules [ 697.816991] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.817140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.817206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.817489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.817580] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.343493] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.343493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.343493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.343493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.343493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.343493] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda already deleted. [ 698.343493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a81c9c25-1e6d-492a-a1c6-2ebef0b4bdda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.344154] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 698.344580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.702757] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 698.702757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.702757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.702757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.702757] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.702757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.702757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.702757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.702757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.702757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.702757] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.150856] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 in Status: SUCCESS [ 699.150856] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 deletion is rescheduled due to dependency. [ 699.150856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.204957] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.205330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.205330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.205469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.205670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.205914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.205914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.206175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.206319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.206455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.206666] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.206796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.206882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.207102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.207321] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.207452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.207566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.207727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.207841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.207959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.208290] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.475921] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: SUCCESS [ 699.476276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.476432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.479776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.480049] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.480185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.480456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.480686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.480779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.480873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.480970] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.711314] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22b5f607-a69e-46b7-93e8-49d4437a6864: rpc.has_security_group_logging(os_id): False [ 699.730590] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.731581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.734041] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.734041] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.734041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.734041] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.734546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.734546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.734546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.734546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.734836] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 699.801122] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.801122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.801122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.801122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.801122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.818357] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 699.984146] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.984339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.984399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.984569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.984724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.984816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.984868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.985022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.985103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.985186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.985328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.985408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.985466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.985598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.985724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.985808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.985864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.985986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.986068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.986154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.986238] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.066913] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7e24af7d-a6e2-49a0-a344-ca6fcf93bec1 None None] Enqueued Resource ID: edcec984-d2a7-46d4-8d87-fa299bdee7cc with Priority: HIGHEST for action port [ 700.067574] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edcec984-d2a7-46d4-8d87-fa299bdee7cc with Priority: HIGHEST for action port [ 700.067895] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-edcec984-d2a7-46d4-8d87-fa299bdee7cc taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.068232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edcec984-d2a7-46d4-8d87-fa299bdee7cc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.069527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edcec984-d2a7-46d4-8d87-fa299bdee7cc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.069527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edcec984-d2a7-46d4-8d87-fa299bdee7cc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.069527] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edcec984-d2a7-46d4-8d87-fa299bdee7cc',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.171563] env[65161]: INFO networking_nsxv3.common.synchronization [None req-72e4b028-076b-44a8-8ab0-7022ec04b7ff None None] Enqueued Resource ID: 78c2e45d-0957-4bf4-8004-60cf9cb423de with Priority: HIGHEST for action port [ 700.172175] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c2e45d-0957-4bf4-8004-60cf9cb423de with Priority: HIGHEST for action port [ 700.173080] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-78c2e45d-0957-4bf4-8004-60cf9cb423de taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.173080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78c2e45d-0957-4bf4-8004-60cf9cb423de" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.173080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78c2e45d-0957-4bf4-8004-60cf9cb423de" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.173080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78c2e45d-0957-4bf4-8004-60cf9cb423de" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.173080] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78c2e45d-0957-4bf4-8004-60cf9cb423de',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.489942] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa3f13db-d36f-47b7-bca4-30b32f714725: rpc.has_security_group_logging(os_id): False [ 700.517252] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.517252] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.517252] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.517252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.517680] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.517680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.517680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.518186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.518186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.518186] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 is going to be created. [ 700.571427] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edcec984-d2a7-46d4-8d87-fa299bdee7cc [ 700.571661] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.571793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.571902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.572094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.572238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.572291] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edcec984-d2a7-46d4-8d87-fa299bdee7cc already deleted. [ 700.572380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edcec984-d2a7-46d4-8d87-fa299bdee7cc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.594480] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.594740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.594806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.595144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.595352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.613718] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: IN_PROGRESS for 2s [ 700.679612] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78c2e45d-0957-4bf4-8004-60cf9cb423de [ 700.679930] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.680125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.680256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.680572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.680661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.680790] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78c2e45d-0957-4bf4-8004-60cf9cb423de already deleted. [ 700.680900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78c2e45d-0957-4bf4-8004-60cf9cb423de" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.012271] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2952b92-a609-40b0-b1f9-f654f83d0847 req-a31735bd-e085-443e-b9e8-8cf82e4e9467 tempest-ServersTestManualDisk-1978629773 tempest-ServersTestManualDisk-1978629773-project-member] Enqueued Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_members [ 701.013075] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_members [ 701.013526] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc716056-e80f-437c-a978-42b0cd24b9c7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.013526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.013526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.014547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.015297] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.015407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.015475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.015684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.016438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.018040] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.480126] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.480330] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-602" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.480447] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-602" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.480766] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-602" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.481786] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.485018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.485018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.485018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.485018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.485018] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.485018] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.485018] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.485018] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.485018] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.485018] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.485018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.505361] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.505571] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.505689] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.505857] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-602" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.506169] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-4f00cf89-0151-488c-939a-43e186b6e8a8 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.506373] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-4f00cf89-0151-488c-939a-43e186b6e8a8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.506517] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-4f00cf89-0151-488c-939a-43e186b6e8a8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.506877] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-4f00cf89-0151-488c-939a-43e186b6e8a8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.507024] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f00cf89-0151-488c-939a-43e186b6e8a8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.519237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.519417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.519505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.519707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.519803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.520012] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.520120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.520184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.520333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.520423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.520507] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc716056-e80f-437c-a978-42b0cd24b9c7 already deleted. [ 701.520588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.838091] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 701.838361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.010238] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.011260] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.011260] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.011260] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.011260] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.011260] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 4f00cf89-0151-488c-939a-43e186b6e8a8 not found, creating... [ 702.011490] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.011676] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.013461] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.013461] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.013461] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.013461] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.013461] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.013461] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.013461] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.014851] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.014851] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 4f00cf89-0151-488c-939a-43e186b6e8a8 is going to be created. [ 702.045809] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.045809] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.045809] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.045809] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.045809] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.046254] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-4f00cf89-0151-488c-939a-43e186b6e8a8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.629753] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: SUCCESS [ 702.629753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.850078] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2952b92-a609-40b0-b1f9-f654f83d0847 req-03dd827d-265a-44c6-b5a5-4aec87755c7e service nova] Enqueued Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_rules [ 702.850078] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2952b92-a609-40b0-b1f9-f654f83d0847 req-03dd827d-265a-44c6-b5a5-4aec87755c7e service nova] Enqueued Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_members [ 702.850078] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2952b92-a609-40b0-b1f9-f654f83d0847 req-03dd827d-265a-44c6-b5a5-4aec87755c7e service nova] Enqueued Resource ID: 4f00cf89-0151-488c-939a-43e186b6e8a8 with Priority: HIGHEST for action port [ 702.853332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_rules [ 702.853332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_members [ 702.853332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f00cf89-0151-488c-939a-43e186b6e8a8 with Priority: HIGHEST for action port [ 702.853332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc716056-e80f-437c-a978-42b0cd24b9c7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.853332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.853332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853332] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.853332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc716056-e80f-437c-a978-42b0cd24b9c7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.853332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.853332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.854696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.855047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.855347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.855591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.858182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.858182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.858182] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.858182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f00cf89-0151-488c-939a-43e186b6e8a8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.858182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f00cf89-0151-488c-939a-43e186b6e8a8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.858182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f00cf89-0151-488c-939a-43e186b6e8a8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.858182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f00cf89-0151-488c-939a-43e186b6e8a8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.858755] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f00cf89-0151-488c-939a-43e186b6e8a8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.862483] env[65161]: INFO networking_nsxv3.common.synchronization [None req-38809a85-4e3b-4767-b0ed-182396d6087b None None] Enqueued Resource ID: 344f65a1-c16c-4b01-8ebd-e65d1ed09173 with Priority: HIGHEST for action port [ 702.863478] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 344f65a1-c16c-4b01-8ebd-e65d1ed09173 with Priority: HIGHEST for action port [ 702.864344] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-344f65a1-c16c-4b01-8ebd-e65d1ed09173 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.864344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-344f65a1-c16c-4b01-8ebd-e65d1ed09173" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.866896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-344f65a1-c16c-4b01-8ebd-e65d1ed09173" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.866896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-344f65a1-c16c-4b01-8ebd-e65d1ed09173" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.866896] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('344f65a1-c16c-4b01-8ebd-e65d1ed09173',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.364338] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc716056-e80f-437c-a978-42b0cd24b9c7 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.364338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.364338] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.368198] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f00cf89-0151-488c-939a-43e186b6e8a8 with status ACTIVE [ 703.368198] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.368198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.368198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.368198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.368198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.368198] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.368198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.370301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.370412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.370515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.370743] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.370848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.370909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.371097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.371173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.371342] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f00cf89-0151-488c-939a-43e186b6e8a8 is going to be updated. [ 703.372607] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 344f65a1-c16c-4b01-8ebd-e65d1ed09173 [ 703.372745] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.372846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.372906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.373528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.373624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.373708] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:344f65a1-c16c-4b01-8ebd-e65d1ed09173 already deleted. [ 703.373785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-344f65a1-c16c-4b01-8ebd-e65d1ed09173" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.400658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.400658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.400658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.400658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.400658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.400963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f00cf89-0151-488c-939a-43e186b6e8a8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.767485] env[65161]: INFO networking_nsxv3.common.synchronization [None req-eb6770e6-15b3-49c5-a3ab-4f3e22ae2296 None None] Enqueued Resource ID: 88f617c8-4120-4626-ac4c-8d7ae21fe692 with Priority: HIGHEST for action port [ 703.771814] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88f617c8-4120-4626-ac4c-8d7ae21fe692 with Priority: HIGHEST for action port [ 703.771814] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-88f617c8-4120-4626-ac4c-8d7ae21fe692 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.771814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88f617c8-4120-4626-ac4c-8d7ae21fe692" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.771814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88f617c8-4120-4626-ac4c-8d7ae21fe692" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.771814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88f617c8-4120-4626-ac4c-8d7ae21fe692" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.771814] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88f617c8-4120-4626-ac4c-8d7ae21fe692',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.874062] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.273159] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88f617c8-4120-4626-ac4c-8d7ae21fe692 [ 704.273159] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.273311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.273870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.273870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.273984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.274049] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88f617c8-4120-4626-ac4c-8d7ae21fe692 already deleted. [ 704.274136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88f617c8-4120-4626-ac4c-8d7ae21fe692" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.378763] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.378897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.378952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.379202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.379297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.379402] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc716056-e80f-437c-a978-42b0cd24b9c7 is going to be created. [ 704.403651] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.403813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.403887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.404356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.404531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.414948] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc716056-e80f-437c-a978-42b0cd24b9c7 in Status: UNINITIALIZED for 2s [ 704.551302] env[65161]: INFO networking_nsxv3.common.synchronization [req-7f565c99-90cd-427e-ac25-e7e922836d1b req-b1808276-8ade-4bca-8ad2-ea827c6834b5 tempest-ServerExternalEventsTest-985681375 tempest-ServerExternalEventsTest-985681375-project-member] Enqueued Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGHEST for action security_group_members [ 704.552190] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGHEST for action security_group_members [ 704.552660] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7980d5f-c7aa-4292-9189-bc351c994c0f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.552833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.553069] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.553337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.553559] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.553710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.553806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.554071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.554239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.554427] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.999197] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.999566] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.999656] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.000108] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.000554] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.000808] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.000970] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.002131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.002131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.002131] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.002131] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.002131] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.002897] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.007235] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.007235] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.007235] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.043125] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.043727] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.044146] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.044536] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.045186] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-f2875012-1d0a-42fd-a3af-9672aeca9cce taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.045651] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-f2875012-1d0a-42fd-a3af-9672aeca9cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.045986] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-f2875012-1d0a-42fd-a3af-9672aeca9cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.046552] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-f2875012-1d0a-42fd-a3af-9672aeca9cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.046931] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2875012-1d0a-42fd-a3af-9672aeca9cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.058150] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.058150] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.058150] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7980d5f-c7aa-4292-9189-bc351c994c0f already deleted. [ 705.058150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.550583] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.550914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.551016] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.551397] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.551564] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.551700] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port f2875012-1d0a-42fd-a3af-9672aeca9cce not found, creating... [ 705.552066] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.552292] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.552455] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.552748] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.552791] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.553122] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.553399] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.555230] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.556542] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.556826] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.557046] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: f2875012-1d0a-42fd-a3af-9672aeca9cce is going to be created. [ 705.584038] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.584038] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.584300] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.585444] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.585444] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.585444] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-f2875012-1d0a-42fd-a3af-9672aeca9cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.146740] env[65161]: INFO networking_nsxv3.common.synchronization [req-18c75192-c3e2-4610-ac79-2bb545844e67 req-e41e098f-45e6-4de3-af03-0878252be9a0 tempest-TenantUsagesTestJSON-1931773304 tempest-TenantUsagesTestJSON-1931773304-project-member] Enqueued Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGHEST for action security_group_members [ 706.147401] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGHEST for action security_group_members [ 706.147737] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e081805-9c1f-4f53-b736-a7dddaec90b6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.147865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.147935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.148158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.148381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.148513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.148589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.148738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.148830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.148928] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.360563] env[65161]: INFO networking_nsxv3.common.synchronization [req-7f565c99-90cd-427e-ac25-e7e922836d1b req-652b1179-2879-480a-afbd-08f255da8529 service nova] Enqueued Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGHEST for action security_group_rules [ 706.360748] env[65161]: INFO networking_nsxv3.common.synchronization [req-7f565c99-90cd-427e-ac25-e7e922836d1b req-652b1179-2879-480a-afbd-08f255da8529 service nova] Enqueued Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGHEST for action security_group_members [ 706.360912] env[65161]: INFO networking_nsxv3.common.synchronization [req-7f565c99-90cd-427e-ac25-e7e922836d1b req-652b1179-2879-480a-afbd-08f255da8529 service nova] Enqueued Resource ID: f2875012-1d0a-42fd-a3af-9672aeca9cce with Priority: HIGHEST for action port [ 706.361786] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGHEST for action security_group_rules [ 706.361966] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGHEST for action security_group_members [ 706.362348] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2875012-1d0a-42fd-a3af-9672aeca9cce with Priority: HIGHEST for action port [ 706.362889] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7980d5f-c7aa-4292-9189-bc351c994c0f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.363479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.363479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.364234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.364454] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.366301] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7980d5f-c7aa-4292-9189-bc351c994c0f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.366708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.367060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.367277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.367591] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.367829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.367988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.368332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.368434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.368580] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.369665] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2875012-1d0a-42fd-a3af-9672aeca9cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.371569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2875012-1d0a-42fd-a3af-9672aeca9cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.371569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2875012-1d0a-42fd-a3af-9672aeca9cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.371569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2875012-1d0a-42fd-a3af-9672aeca9cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.371569] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2875012-1d0a-42fd-a3af-9672aeca9cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.426236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc716056-e80f-437c-a978-42b0cd24b9c7 in Status: SUCCESS [ 706.426396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.426522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.426766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.427133] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.427375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.427483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.427719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.427856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.428014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.428375] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.653032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.653032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.653032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.653032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.653032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.653032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.653032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.653032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.653386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.653386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.653534] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 is going to be updated. [ 706.686257] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.686430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.686479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.686723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.686883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.701445] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 in Status: IN_PROGRESS for 2s [ 706.872638] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.879486] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7980d5f-c7aa-4292-9189-bc351c994c0f taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.879645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.879849] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2875012-1d0a-42fd-a3af-9672aeca9cce with status ACTIVE [ 706.880038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.880146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.880235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.880872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.880981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.881904] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.881904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.881904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.881904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.882526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.882979] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.883115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.883180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.885187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.885274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.885314] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2875012-1d0a-42fd-a3af-9672aeca9cce is going to be updated. [ 706.917262] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.917606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.917906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.918254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.918562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.918837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2875012-1d0a-42fd-a3af-9672aeca9cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.930047] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.129892] env[65161]: INFO networking_nsxv3.common.synchronization [None req-57799e80-fdea-4093-8bbc-9b047625150d tempest-ServerRescueNegativeTestJSON-1925364810 tempest-ServerRescueNegativeTestJSON-1925364810-project-member] Enqueued Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_rules [ 707.130631] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_rules [ 707.132610] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.132709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.132756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.133067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.133154] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.285468] env[65161]: INFO networking_nsxv3.common.synchronization [None req-d5c1e6c2-5f96-4d51-8fab-4b72a47f1b64 tempest-ServerRescueNegativeTestJSON-1925364810 tempest-ServerRescueNegativeTestJSON-1925364810-project-member] Enqueued Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_rules [ 707.286285] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_rules [ 707.286548] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.286679] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.390394] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.434856] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc716056-e80f-437c-a978-42b0cd24b9c7: rpc.has_security_group_logging(os_id): False [ 707.455231] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.455380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.455447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.455664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.455755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.456022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.456091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.456160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.456307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.456384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.456489] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc716056-e80f-437c-a978-42b0cd24b9c7 is going to be created. [ 707.530995] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.531097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.531127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.531570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.531849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.558792] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc716056-e80f-437c-a978-42b0cd24b9c7 in Status: IN_PROGRESS for 2s [ 707.677520] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.677701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.677752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.677995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.678097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.678195] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 already deleted. [ 707.678281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.678721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.678721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.678721] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.893421] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.893581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.893663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.893884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.893989] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.894089] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7980d5f-c7aa-4292-9189-bc351c994c0f is going to be created. [ 707.924701] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.925026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.925026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.925729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.926027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.938200] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7980d5f-c7aa-4292-9189-bc351c994c0f in Status: UNINITIALIZED for 2s [ 708.199490] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.199720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.199792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.200025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.200122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.200223] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 already deleted. [ 708.200308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.711399] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 in Status: SUCCESS [ 708.711714] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 deletion is rescheduled due to dependency. [ 708.711714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.575516] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc716056-e80f-437c-a978-42b0cd24b9c7 in Status: SUCCESS [ 709.575636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.641230] env[65161]: INFO networking_nsxv3.common.synchronization [req-9928634c-989d-48a3-885c-3b7613101d1c req-11db9967-284a-4b44-8438-4d83a467f690 tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 709.641925] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 709.643528] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.643814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.645149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.645483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.645674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.645901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.645901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.646131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.646131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.646227] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.828881] env[65161]: INFO networking_nsxv3.common.synchronization [req-ad808c1e-3456-4a1a-89e6-a65551effe34 req-79a9a853-a0a8-45a3-b7c9-3109b42d3f5b tempest-SecurityGroupRulesTestJSON-6335183 tempest-SecurityGroupRulesTestJSON-6335183-project-member] Enqueued Resource ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d with Priority: HIGHEST for action security_group_rules [ 709.829514] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d with Priority: HIGHEST for action security_group_rules [ 709.829812] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.829928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.829991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.830573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.831502] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4fd2d69-7055-48e7-906b-8fa8ec6d974d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.950638] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7980d5f-c7aa-4292-9189-bc351c994c0f in Status: SUCCESS [ 709.950638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.950638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.950853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.951097] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.951298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.951409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.951896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.951896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.951896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.951896] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.150320] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.150464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.150503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.150746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.150840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.151064] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.151166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.151266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.151422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.151533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.151645] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 already deleted. [ 710.151726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.272307] env[65161]: INFO networking_nsxv3.common.synchronization [None req-cc9db87d-2df4-4414-acae-41cdc495385e None None] Enqueued Resource ID: a7d3a2c5-1ec3-49b9-b04a-4b1485ada395 with Priority: HIGHEST for action port [ 710.272517] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d3a2c5-1ec3-49b9-b04a-4b1485ada395 with Priority: HIGHEST for action port [ 710.272859] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d3a2c5-1ec3-49b9-b04a-4b1485ada395 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.272964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d3a2c5-1ec3-49b9-b04a-4b1485ada395" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.273023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d3a2c5-1ec3-49b9-b04a-4b1485ada395" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.274093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d3a2c5-1ec3-49b9-b04a-4b1485ada395" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.274207] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d3a2c5-1ec3-49b9-b04a-4b1485ada395',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.358218] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.359432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.359432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.359819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.360011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.360147] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d already deleted. [ 710.360249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.419473] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.419717] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.419866] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.420248] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.420728] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.420728] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.420913] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.421124] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.421388] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.421653] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.421769] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.421895] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.422031] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.422154] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.422294] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.422465] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.444999] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.445559] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.445559] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.445559] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.445875] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.446095] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.446216] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.446584] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.446736] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16adb2b5-794f-4f33-9184-5b8b07f2d5e6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.454557] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7980d5f-c7aa-4292-9189-bc351c994c0f taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.454755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.454824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.455064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.455236] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.455346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.455422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.455610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.455705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.455791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.455938] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7980d5f-c7aa-4292-9189-bc351c994c0f taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.456040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.456102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.456282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.456472] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.456572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.456642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.456802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.456903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.457045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.457152] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.777369] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7d3a2c5-1ec3-49b9-b04a-4b1485ada395 [ 710.777533] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.777670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.777743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.777995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.778107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.778207] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7d3a2c5-1ec3-49b9-b04a-4b1485ada395 already deleted. [ 710.778291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d3a2c5-1ec3-49b9-b04a-4b1485ada395" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.950539] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.950858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.950858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.950981] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.951148] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.951350] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 16adb2b5-794f-4f33-9184-5b8b07f2d5e6 not found, creating... [ 710.951622] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.951778] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.952396] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.952396] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.952396] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.952857] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.952857] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.952857] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.953286] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.953286] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.953286] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 16adb2b5-794f-4f33-9184-5b8b07f2d5e6 is going to be created. [ 710.959260] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7980d5f-c7aa-4292-9189-bc351c994c0f: rpc.has_security_group_logging(os_id): False [ 710.986016] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.986214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.986294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.986651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.986758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.987190] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.987373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.987488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.987752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.987899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.988160] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.988314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.988365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.988598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.988695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.988927] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.989048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.989111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.989311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.989392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.989501] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7980d5f-c7aa-4292-9189-bc351c994c0f is going to be created. [ 710.992159] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.992412] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.992565] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.992924] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.993206] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.993428] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.120095] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.120095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.120095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.120383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.120790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.158446] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7980d5f-c7aa-4292-9189-bc351c994c0f in Status: IN_PROGRESS for 2s [ 711.717582] env[65161]: INFO networking_nsxv3.common.synchronization [req-9928634c-989d-48a3-885c-3b7613101d1c req-0ba982b0-3a95-4c58-825c-a07c78920f0c service nova] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 711.717853] env[65161]: INFO networking_nsxv3.common.synchronization [req-9928634c-989d-48a3-885c-3b7613101d1c req-0ba982b0-3a95-4c58-825c-a07c78920f0c service nova] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 711.717957] env[65161]: INFO networking_nsxv3.common.synchronization [req-9928634c-989d-48a3-885c-3b7613101d1c req-0ba982b0-3a95-4c58-825c-a07c78920f0c service nova] Enqueued Resource ID: 16adb2b5-794f-4f33-9184-5b8b07f2d5e6 with Priority: HIGHEST for action port [ 711.718667] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 711.718667] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 711.718809] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16adb2b5-794f-4f33-9184-5b8b07f2d5e6 with Priority: HIGHEST for action port [ 711.719009] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.724033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.724033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.724033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.724033] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.724882] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.726670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.726670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.726670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.726670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.726670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.726670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.726670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.726670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.726670] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.727482] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.727612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.727938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.727938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.728042] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16adb2b5-794f-4f33-9184-5b8b07f2d5e6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.979656] env[65161]: INFO networking_nsxv3.common.synchronization [req-c0505129-44a7-4886-a826-6a3f32f4ca54 req-dc65210f-7af6-4ed1-99e9-d74ed72a326a tempest-ServerPasswordTestJSON-702433198 tempest-ServerPasswordTestJSON-702433198-project-member] Enqueued Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGHEST for action security_group_members [ 711.981757] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGHEST for action security_group_members [ 711.982238] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-86add6f1-e722-4f5b-89cc-222fed23d419 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.982472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.982618] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.983099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.983379] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.983581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.983767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.984390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.984390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.984390] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.223083] env[65161]: INFO networking_nsxv3.common.synchronization [req-21160b1f-eecd-4d5d-ae45-c350c98fd75e req-a2125a03-c9d3-49fd-9482-3b486fca2c34 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 712.223353] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 712.223654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.223771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.223840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.224055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.224211] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.224314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.224391] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.224522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.224609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.224707] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.229579] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.231098] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.231213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.231676] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16adb2b5-794f-4f33-9184-5b8b07f2d5e6 with status ACTIVE [ 712.231846] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.231960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.232038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.232269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.232319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.232480] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.232579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.232636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.232988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.232988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.233178] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.233338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.233378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.233500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.233580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.233671] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16adb2b5-794f-4f33-9184-5b8b07f2d5e6 is going to be updated. [ 712.260661] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.260812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.260886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.261129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.261288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.261554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16adb2b5-794f-4f33-9184-5b8b07f2d5e6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.372171] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-760 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.373110] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-760" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.373318] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-760" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.373728] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-760" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.374106] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.374365] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.374529] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.374804] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.374998] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.375263] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.375437] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.375584] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.375747] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.375959] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.376181] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.376542] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.398337] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.398590] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.398733] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.398932] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-760" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.399406] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.399619] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.399713] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.400168] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.400333] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.488751] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.488751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.488751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.488751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.489158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.489158] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.489261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.489298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.489475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.489547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.489640] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86add6f1-e722-4f5b-89cc-222fed23d419 already deleted. [ 712.489719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.727658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.728606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.728930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.729385] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.729651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.732550] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.732550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.732550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.732550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.732550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.732550] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be updated. [ 712.733393] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.766195] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.766389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.766430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.766808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.766961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.779272] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 712.905181] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.905457] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.905619] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.905992] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.906214] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.906406] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37 not found, creating... [ 712.906756] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.906935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.907098] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.907788] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.907788] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.908881] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.910537] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.910814] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.911415] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.911739] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.913328] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37 is going to be created. [ 712.943023] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.943023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.943023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.943023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.943023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.943023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.973143] env[65161]: INFO networking_nsxv3.common.synchronization [None req-13e1d558-00ac-4410-946f-ea98fb234606 None None] Enqueued Resource ID: b89aa5c0-245e-4823-aa3a-539a984a47dc with Priority: HIGHEST for action port [ 712.973741] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89aa5c0-245e-4823-aa3a-539a984a47dc with Priority: HIGHEST for action port [ 712.974130] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b89aa5c0-245e-4823-aa3a-539a984a47dc taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.974208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b89aa5c0-245e-4823-aa3a-539a984a47dc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.974296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b89aa5c0-245e-4823-aa3a-539a984a47dc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.974549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b89aa5c0-245e-4823-aa3a-539a984a47dc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.974685] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89aa5c0-245e-4823-aa3a-539a984a47dc',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.170746] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7980d5f-c7aa-4292-9189-bc351c994c0f in Status: SUCCESS [ 713.171187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.236254] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.240133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.240293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.240582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.240754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.240892] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be created. [ 713.273663] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.274694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.274694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.274694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.274694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.289763] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: UNINITIALIZED for 2s [ 713.480816] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b89aa5c0-245e-4823-aa3a-539a984a47dc [ 713.480972] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.481182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.481392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.481655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.481781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.481888] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b89aa5c0-245e-4823-aa3a-539a984a47dc already deleted. [ 713.482057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b89aa5c0-245e-4823-aa3a-539a984a47dc" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.724045] env[65161]: INFO networking_nsxv3.common.synchronization [req-e29bf718-d113-494a-970b-d97a622d1854 req-5240a889-f873-4f5b-b671-edae47cfe0e3 tempest-SecurityGroupRulesTestJSON-6335183 tempest-SecurityGroupRulesTestJSON-6335183-project-member] Enqueued Resource ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d with Priority: HIGHEST for action security_group_rules [ 713.725377] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d with Priority: HIGHEST for action security_group_rules [ 713.725377] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.726336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.726447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.726723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.726835] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4fd2d69-7055-48e7-906b-8fa8ec6d974d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.801058] env[65161]: INFO networking_nsxv3.common.synchronization [req-c0505129-44a7-4886-a826-6a3f32f4ca54 req-60201cda-33ad-4147-8d18-521172d93155 service nova] Enqueued Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGHEST for action security_group_rules [ 713.801058] env[65161]: INFO networking_nsxv3.common.synchronization [req-c0505129-44a7-4886-a826-6a3f32f4ca54 req-60201cda-33ad-4147-8d18-521172d93155 service nova] Enqueued Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGHEST for action security_group_members [ 713.801058] env[65161]: INFO networking_nsxv3.common.synchronization [req-c0505129-44a7-4886-a826-6a3f32f4ca54 req-60201cda-33ad-4147-8d18-521172d93155 service nova] Enqueued Resource ID: 2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37 with Priority: HIGHEST for action port [ 713.801180] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGHEST for action security_group_rules [ 713.801489] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGHEST for action security_group_members [ 713.801670] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37 with Priority: HIGHEST for action port [ 713.802186] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86add6f1-e722-4f5b-89cc-222fed23d419 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.802518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.802764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.803128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.803366] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.804187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-86add6f1-e722-4f5b-89cc-222fed23d419 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.804349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.804488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.804710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.805194] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.805194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.805194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.805194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.805336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.805363] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.806264] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.806372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.806464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.806656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.806771] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.256527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.257048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.257048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.257129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.257307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.257427] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d already deleted. [ 714.257658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.314535] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-86add6f1-e722-4f5b-89cc-222fed23d419 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.314535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.314535] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.314535] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37 with status ACTIVE [ 714.314535] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.314535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.314535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.314535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.315611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.315611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.315611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.315611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.315611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.315611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.315611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.316025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.316025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.316025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.316135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.316196] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37 is going to be updated. [ 714.344480] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.344480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.344480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.344959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.347140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.347140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bdb6cdc-9f08-49b1-98d2-3c16c2f9ad37" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.793610] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 714.793816] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda deletion is rescheduled due to dependency. [ 714.793939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.819698] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.301058] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 715.301058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.301058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.301058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.301058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.301058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.301058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.301058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.301058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.301058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.301588] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.323162] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.323278] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.323330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.323523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.323725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.323843] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86add6f1-e722-4f5b-89cc-222fed23d419 is going to be created. [ 715.352638] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.352801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.352871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.353125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.353298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.364921] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86add6f1-e722-4f5b-89cc-222fed23d419 in Status: UNINITIALIZED for 2s [ 715.805265] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.308637] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dad00945-a380-4452-8a37-64cfdbf9d432: rpc.has_security_group_logging(os_id): False [ 716.330649] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.330875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.330875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.331097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.331192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.331519] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.331626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.331674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.331835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.331911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.332008] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be created. [ 716.413654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.413654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.413654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.413654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.413654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.429318] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 717.376989] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86add6f1-e722-4f5b-89cc-222fed23d419 in Status: SUCCESS [ 717.377386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.377552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.377881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.378204] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.378412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.378533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.378792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.378915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.380102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.380102] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.673086] env[65161]: INFO networking_nsxv3.common.synchronization [req-f159d17d-6877-41f4-b715-cf1c0af92a4e req-a38b08f0-2223-4405-9c97-8567798d6329 tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 717.678125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 717.679200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.679387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.679483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.679857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.680116] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.680278] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.680389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.680640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.680787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.680947] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.883804] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-86add6f1-e722-4f5b-89cc-222fed23d419 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.883804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.883804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.883804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.888135] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.888135] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-86add6f1-e722-4f5b-89cc-222fed23d419 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.888135] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.888135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.888732] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.022785] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-e5ade3ab-556b-467c-b1a8-5e185e2ef790 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 718.023688] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 718.024233] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.024461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.024562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.024962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.025207] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.025384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.028031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.028031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.028031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.028031] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.183887] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.184106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.184165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.184416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.184593] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.184856] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.184965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.185061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.185229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.185329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.185523] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 718.224990] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.225183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.225241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.225473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.225693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.237833] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 718.393344] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86add6f1-e722-4f5b-89cc-222fed23d419: rpc.has_security_group_logging(os_id): False [ 718.415532] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.415688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.423022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.423022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.423022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.423022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.423676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.423676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.423676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.423676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.423676] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86add6f1-e722-4f5b-89cc-222fed23d419 is going to be created. [ 718.444490] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 718.444766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.484738] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.484869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.484869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.485602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.485602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.499206] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86add6f1-e722-4f5b-89cc-222fed23d419 in Status: IN_PROGRESS for 2s [ 718.530455] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.533021] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.533021] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe already deleted. [ 718.533021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.730350] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-4dc61406-9852-4cd8-b9ec-1c9be7509844 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 718.730350] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 718.730350] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.730526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.730526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.730712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.730822] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.730908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.730957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.731248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.731494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.731692] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.234656] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.235267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.235267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.235267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.235267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.235490] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.235573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.235626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.235990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.236086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.236129] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe already deleted. [ 719.236200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.237414] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-252c7a8b-73db-483a-9813-d4aa4c0d5842 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 719.238538] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 719.239564] env[65161]: INFO networking_nsxv3.common.synchronization [req-f5c81e51-0358-4169-87fb-8cef2e3c517f req-063b4d15-ec55-4735-be12-5b504f4f933c tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_members [ 719.239876] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.239987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.240072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.240251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.240405] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.240504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.240559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.240707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.240786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.240874] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.241970] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGHEST for action security_group_members [ 719.242475] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f835b02-6879-4c48-95a4-22113f8049b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.242597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.242658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.242829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.242973] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.243082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.243144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.243289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.243375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.243468] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.744599] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.744916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.744916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.745214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.745365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.745650] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.745799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.745962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.746350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.746350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.746350] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe already deleted. [ 719.746524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.747345] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.748595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.748696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.748865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.748957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.749187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.749436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.749622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.749710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.749809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.749895] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f835b02-6879-4c48-95a4-22113f8049b5 is going to be updated. [ 719.801440] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.801617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.801777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.802161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.802240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.813292] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f835b02-6879-4c48-95a4-22113f8049b5 in Status: IN_PROGRESS for 2s [ 719.926419] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.927018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-119" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.927018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-119" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.927018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-119" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.927551] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.927551] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.927551] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.927835] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.928134] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.930560] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.931535] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.931535] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.931535] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.932190] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.932190] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.932261] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.960622] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.960960] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 719.960960] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.962098] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-119" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.962098] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-f3217fca-8645-44ac-ae5e-3e205752cbe2 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.962098] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-f3217fca-8645-44ac-ae5e-3e205752cbe2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.962392] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-f3217fca-8645-44ac-ae5e-3e205752cbe2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.962625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-f3217fca-8645-44ac-ae5e-3e205752cbe2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.962809] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3217fca-8645-44ac-ae5e-3e205752cbe2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.254205] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 720.254361] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 720.254691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.466077] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.466449] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.466587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.466887] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.467039] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.467183] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port f3217fca-8645-44ac-ae5e-3e205752cbe2 not found, creating... [ 720.467484] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.467673] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.467792] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.468051] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.468216] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.468536] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.470997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.470997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.470997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.470997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.470997] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: f3217fca-8645-44ac-ae5e-3e205752cbe2 is going to be created. [ 720.492410] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.493465] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.493648] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.494823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.494823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.494823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-f3217fca-8645-44ac-ae5e-3e205752cbe2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.523788] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86add6f1-e722-4f5b-89cc-222fed23d419 in Status: SUCCESS [ 720.523788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.269414] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-c904062f-1614-4d6e-94f8-b8fd18253e23 service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 721.269842] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-c904062f-1614-4d6e-94f8-b8fd18253e23 service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 721.269842] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-c904062f-1614-4d6e-94f8-b8fd18253e23 service nova] Enqueued Resource ID: f3217fca-8645-44ac-ae5e-3e205752cbe2 with Priority: HIGHEST for action port [ 721.270412] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 721.270538] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 721.270684] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3217fca-8645-44ac-ae5e-3e205752cbe2 with Priority: HIGHEST for action port [ 721.270910] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.271069] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.271115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.271481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.271597] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.273104] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.273104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.273104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.273104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.273287] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.273329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.273378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.273943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.273943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.273943] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.274701] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3217fca-8645-44ac-ae5e-3e205752cbe2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.274817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3217fca-8645-44ac-ae5e-3e205752cbe2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.274886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3217fca-8645-44ac-ae5e-3e205752cbe2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.275553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3217fca-8645-44ac-ae5e-3e205752cbe2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.275553] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3217fca-8645-44ac-ae5e-3e205752cbe2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.779164] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.779393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.779543] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.781245] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3217fca-8645-44ac-ae5e-3e205752cbe2 with status ACTIVE [ 721.781611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.781756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.781837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.782176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.782271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.782821] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.782945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.783074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.783238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.783397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.783599] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.783730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.783848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.783945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.784044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.784185] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3217fca-8645-44ac-ae5e-3e205752cbe2 is going to be updated. [ 721.806476] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.806639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.806678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.807080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.807080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.807224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3217fca-8645-44ac-ae5e-3e205752cbe2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.826459] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f835b02-6879-4c48-95a4-22113f8049b5 in Status: SUCCESS [ 721.826717] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f835b02-6879-4c48-95a4-22113f8049b5 deletion is rescheduled due to dependency. [ 721.826856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.093588] env[65161]: INFO networking_nsxv3.common.synchronization [req-94395f03-7695-4490-9d51-a2ef25f42ac5 req-b5e9070a-72d2-4f2c-affc-c145d62683e3 tempest-SecurityGroupRulesTestJSON-6335183 tempest-SecurityGroupRulesTestJSON-6335183-project-member] Enqueued Resource ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d with Priority: HIGHEST for action security_group_rules [ 722.096767] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d with Priority: HIGHEST for action security_group_rules [ 722.097503] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.097667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.097740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.097951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.098037] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4fd2d69-7055-48e7-906b-8fa8ec6d974d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.127543] env[65161]: INFO networking_nsxv3.common.synchronization [None req-34e9e29f-2556-4659-b694-974879b68614 None None] Enqueued Resource ID: 9d1be20f-a541-41b1-85ff-66aa2a4ce8ca with Priority: HIGHEST for action port [ 722.128282] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1be20f-a541-41b1-85ff-66aa2a4ce8ca with Priority: HIGHEST for action port [ 722.128653] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d1be20f-a541-41b1-85ff-66aa2a4ce8ca taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.128792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d1be20f-a541-41b1-85ff-66aa2a4ce8ca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.128861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d1be20f-a541-41b1-85ff-66aa2a4ce8ca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.129277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d1be20f-a541-41b1-85ff-66aa2a4ce8ca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.129371] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d1be20f-a541-41b1-85ff-66aa2a4ce8ca',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.286354] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.417331] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.417550] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-548" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.417689] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-548" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.419367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-548" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.419367] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.419367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.419367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.419367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.419367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.421752] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.421752] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.421752] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.421752] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.421752] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.421752] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.421752] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.442593] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.443066] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.443345] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.445018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-548" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.445018] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-6d13cfc2-fcc6-4646-870d-9bc04db6a622 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.445018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-6d13cfc2-fcc6-4646-870d-9bc04db6a622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.445018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-6d13cfc2-fcc6-4646-870d-9bc04db6a622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.445018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-6d13cfc2-fcc6-4646-870d-9bc04db6a622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.445018] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d13cfc2-fcc6-4646-870d-9bc04db6a622',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.623530] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.623717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.623892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.624886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.624886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.624886] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4fd2d69-7055-48e7-906b-8fa8ec6d974d already deleted. [ 722.624886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4fd2d69-7055-48e7-906b-8fa8ec6d974d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.631897] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d1be20f-a541-41b1-85ff-66aa2a4ce8ca [ 722.632218] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.632379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.632466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.632738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.632855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.632971] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d1be20f-a541-41b1-85ff-66aa2a4ce8ca already deleted. [ 722.633106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d1be20f-a541-41b1-85ff-66aa2a4ce8ca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.789366] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.789905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.789905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.790252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.790995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.791195] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be created. [ 722.818390] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.818534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.818599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.818802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.818960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.831543] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: UNINITIALIZED for 2s [ 722.951047] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.951047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.951047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.951047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.951047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.951047] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 6d13cfc2-fcc6-4646-870d-9bc04db6a622 not found, creating... [ 722.951047] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.951047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.951047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.951047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.951047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.951568] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.951568] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.951932] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.952498] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.952857] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.953335] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 6d13cfc2-fcc6-4646-870d-9bc04db6a622 is going to be created. [ 722.978291] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.978291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.978291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.978291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.978291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.978291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-6d13cfc2-fcc6-4646-870d-9bc04db6a622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.706293] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-ee1604b5-e0e9-4afc-b787-1bd030b7ba5d service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 723.706555] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-ee1604b5-e0e9-4afc-b787-1bd030b7ba5d service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 723.706633] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-ee1604b5-e0e9-4afc-b787-1bd030b7ba5d service nova] Enqueued Resource ID: 6d13cfc2-fcc6-4646-870d-9bc04db6a622 with Priority: HIGHEST for action port [ 723.707949] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 723.709552] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 723.709552] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d13cfc2-fcc6-4646-870d-9bc04db6a622 with Priority: HIGHEST for action port [ 723.709552] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.709552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.710993] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.710993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.710993] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d13cfc2-fcc6-4646-870d-9bc04db6a622 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.710993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d13cfc2-fcc6-4646-870d-9bc04db6a622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.710993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d13cfc2-fcc6-4646-870d-9bc04db6a622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.710993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d13cfc2-fcc6-4646-870d-9bc04db6a622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.711566] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d13cfc2-fcc6-4646-870d-9bc04db6a622',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.219029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d13cfc2-fcc6-4646-870d-9bc04db6a622 with status ACTIVE [ 724.219029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.219029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.219029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.219029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.219029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d13cfc2-fcc6-4646-870d-9bc04db6a622 is going to be updated. [ 724.241403] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.241939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.241939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.243201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.243589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.243774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d13cfc2-fcc6-4646-870d-9bc04db6a622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.408591] env[65161]: INFO networking_nsxv3.common.synchronization [None req-1cd85c6a-c6a7-4bbb-aaf1-1124148a705a None None] Enqueued Resource ID: 045121e9-4217-43bc-ab79-af064f011b9e with Priority: HIGHEST for action port [ 724.409172] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 045121e9-4217-43bc-ab79-af064f011b9e with Priority: HIGHEST for action port [ 724.409543] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-045121e9-4217-43bc-ab79-af064f011b9e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.409863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-045121e9-4217-43bc-ab79-af064f011b9e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.410641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-045121e9-4217-43bc-ab79-af064f011b9e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.410641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-045121e9-4217-43bc-ab79-af064f011b9e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.410641] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('045121e9-4217-43bc-ab79-af064f011b9e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.826041] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.826041] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-119" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.826041] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-119" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.826041] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-119" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.826504] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.826504] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.826504] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.826681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.826822] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.829186] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.829186] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.829186] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.829186] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.829186] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.829186] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.829186] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.841916] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 724.842235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.842312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.842718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.842718] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.842869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.842900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.843067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.843157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.843246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.843357] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.845387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.845673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.845818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.845936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.845998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.846159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.846242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.846342] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.853233] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.853406] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.853541] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.853739] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-119" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.855225] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-4185566b-18d5-4151-989d-7538df2a8d91 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.855225] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-4185566b-18d5-4151-989d-7538df2a8d91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.855225] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-4185566b-18d5-4151-989d-7538df2a8d91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.855225] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-4185566b-18d5-4151-989d-7538df2a8d91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.855225] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4185566b-18d5-4151-989d-7538df2a8d91',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.915415] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 045121e9-4217-43bc-ab79-af064f011b9e [ 724.915681] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.915829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.915899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.916180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.916288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.916382] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:045121e9-4217-43bc-ab79-af064f011b9e already deleted. [ 724.916463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-045121e9-4217-43bc-ab79-af064f011b9e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.335422] env[65161]: INFO networking_nsxv3.common.synchronization [req-b9e9d340-0568-4dfc-9fa2-ddd9f0033030 req-fcd00621-f798-459a-bb1c-f86b71a93e49 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 725.337240] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 725.337585] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.337715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.337794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.338090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.338373] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.338373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.338501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.338584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.338674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.338771] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.348140] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.348140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.349665] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.358126] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.358221] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.358321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.360554] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.360554] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.360554] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 4185566b-18d5-4151-989d-7538df2a8d91 not found, creating... [ 725.360554] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.361971] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.361971] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.361971] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.362209] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.362372] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.362570] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.362725] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.362964] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.363106] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.363268] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 4185566b-18d5-4151-989d-7538df2a8d91 is going to be created. [ 725.364978] env[65161]: INFO networking_nsxv3.common.synchronization [None req-eb8e2b61-2aa1-4bb5-b2c4-599d65b827ff None None] Enqueued Resource ID: b2c2d764-7589-4025-b162-3efed9096fa1 with Priority: HIGHEST for action port [ 725.370295] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c2d764-7589-4025-b162-3efed9096fa1 with Priority: HIGHEST for action port [ 725.371164] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2c2d764-7589-4025-b162-3efed9096fa1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.371304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2c2d764-7589-4025-b162-3efed9096fa1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.371380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2c2d764-7589-4025-b162-3efed9096fa1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.371664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2c2d764-7589-4025-b162-3efed9096fa1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.374422] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2c2d764-7589-4025-b162-3efed9096fa1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.395721] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.395892] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.396829] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.396829] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.396829] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.396829] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-4185566b-18d5-4151-989d-7538df2a8d91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.851202] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.851202] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.851202] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd already deleted. [ 725.851202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.854635] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.874837] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2c2d764-7589-4025-b162-3efed9096fa1 [ 725.876075] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.876273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.876359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.876746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.876872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.877024] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2c2d764-7589-4025-b162-3efed9096fa1 already deleted. [ 725.877185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2c2d764-7589-4025-b162-3efed9096fa1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.024324] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.024485] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-595" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.024542] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-595" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.024846] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-595" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.025104] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.025757] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.025757] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.025757] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.025757] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.026094] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.026094] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.026094] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.026201] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.026266] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.026372] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.026495] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.047883] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.048164] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.048377] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.048616] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-595" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.048974] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-a3e72240-027c-44dc-b13b-09d7387739a5 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.049170] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.049284] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.049617] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.049750] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3e72240-027c-44dc-b13b-09d7387739a5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.122674] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-4110e2ab-58cd-4a5a-8705-3ae288d460f1 service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 726.122880] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-4110e2ab-58cd-4a5a-8705-3ae288d460f1 service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 726.123051] env[65161]: INFO networking_nsxv3.common.synchronization [req-ead2b9c8-2fb8-4630-9bfb-7185a35157c6 req-4110e2ab-58cd-4a5a-8705-3ae288d460f1 service nova] Enqueued Resource ID: 4185566b-18d5-4151-989d-7538df2a8d91 with Priority: HIGHEST for action port [ 726.123748] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 726.123909] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 726.123999] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4185566b-18d5-4151-989d-7538df2a8d91 with Priority: HIGHEST for action port [ 726.124325] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.124459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.124734] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.124912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.125144] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-4185566b-18d5-4151-989d-7538df2a8d91 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.125253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4185566b-18d5-4151-989d-7538df2a8d91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.125321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4185566b-18d5-4151-989d-7538df2a8d91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.125541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4185566b-18d5-4151-989d-7538df2a8d91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.126050] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4185566b-18d5-4151-989d-7538df2a8d91',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.357650] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.358026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.359620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.359620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.359620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.359620] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 726.391187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.391450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.391496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.391764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.392011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.405559] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 726.552592] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.552834] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.553669] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.553669] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.553669] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.553669] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port a3e72240-027c-44dc-b13b-09d7387739a5 not found, creating... [ 726.553942] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.554989] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.554989] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.554989] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.554989] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.554989] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.554989] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.555509] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.555747] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.555883] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.556190] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: a3e72240-027c-44dc-b13b-09d7387739a5 is going to be created. [ 726.577292] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.577498] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.577662] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.578029] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.578261] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.579027] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.629040] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4185566b-18d5-4151-989d-7538df2a8d91 with status ACTIVE [ 726.629314] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.629478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.629555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.634012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.634012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.634012] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.634012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.634012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.634012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.634269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.634297] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.634472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.634472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.636475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.636636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.639166] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4185566b-18d5-4151-989d-7538df2a8d91 is going to be updated. [ 726.673655] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.673895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.673895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.674628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.674628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.674628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4185566b-18d5-4151-989d-7538df2a8d91" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.363166] env[65161]: INFO networking_nsxv3.common.synchronization [req-b9e9d340-0568-4dfc-9fa2-ddd9f0033030 req-741fdabb-2d54-4297-8094-fba5b3e21416 service nova] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 727.363460] env[65161]: INFO networking_nsxv3.common.synchronization [req-b9e9d340-0568-4dfc-9fa2-ddd9f0033030 req-741fdabb-2d54-4297-8094-fba5b3e21416 service nova] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 727.364212] env[65161]: INFO networking_nsxv3.common.synchronization [req-b9e9d340-0568-4dfc-9fa2-ddd9f0033030 req-741fdabb-2d54-4297-8094-fba5b3e21416 service nova] Enqueued Resource ID: a3e72240-027c-44dc-b13b-09d7387739a5 with Priority: HIGHEST for action port [ 727.364942] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 727.365196] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 727.365277] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3e72240-027c-44dc-b13b-09d7387739a5 with Priority: HIGHEST for action port [ 727.365997] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.366182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.366258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.366587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.366676] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.367699] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.367839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.367911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.368167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.368371] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.368484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.368562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.368792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.368895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.368992] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.370124] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3e72240-027c-44dc-b13b-09d7387739a5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.370288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.370330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.370602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.371156] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3e72240-027c-44dc-b13b-09d7387739a5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.662242] env[65161]: INFO networking_nsxv3.common.synchronization [req-5a872d71-903e-4eb7-a41c-aa16425d4871 req-134879ee-f3a2-472d-ae3e-e4b0c36e8dc6 tempest-ServerRescueNegativeTestJSON-1925364810 tempest-ServerRescueNegativeTestJSON-1925364810-project-member] Enqueued Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_members [ 727.663095] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_members [ 727.663245] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24f796e-b77b-42f0-a7c2-ae92228b28c5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.663582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.663582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.663814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.664143] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.664143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.664564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.667558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.667558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.667665] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.872692] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.873926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.874155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.874441] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3e72240-027c-44dc-b13b-09d7387739a5 with status ACTIVE [ 727.874607] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.874713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.874794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.874971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.875065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.875234] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.875338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.875397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.875774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.875774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.875774] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.876023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.876023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.876148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.878655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.878655] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3e72240-027c-44dc-b13b-09d7387739a5 is going to be updated. [ 727.900705] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.900929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.900929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.901140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.901270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.901494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.170696] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.170876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.170947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.171189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.171275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.171525] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.171654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.171716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.171896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.171970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.172065] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 already deleted. [ 728.173690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.183152] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-179 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.183360] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.183431] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.184163] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.184163] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.184328] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.184502] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.187210] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.187210] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.187210] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.187210] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.187210] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.187210] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.187210] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.187210] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.187210] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.215511] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.215732] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.215991] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.216187] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-179" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.217028] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-73cd5e67-5183-4956-b6c0-23c949cedfbd taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.217028] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-73cd5e67-5183-4956-b6c0-23c949cedfbd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.217028] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-73cd5e67-5183-4956-b6c0-23c949cedfbd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.217243] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-73cd5e67-5183-4956-b6c0-23c949cedfbd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.217372] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73cd5e67-5183-4956-b6c0-23c949cedfbd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.321018] env[65161]: INFO networking_nsxv3.common.synchronization [None req-cd908338-2cf7-4031-ab08-1be1fdaecd02 None None] Enqueued Resource ID: abc718ec-d7fe-4880-b487-11e27ed9aa08 with Priority: HIGHEST for action port [ 728.321018] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc718ec-d7fe-4880-b487-11e27ed9aa08 with Priority: HIGHEST for action port [ 728.321018] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-abc718ec-d7fe-4880-b487-11e27ed9aa08 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.321018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abc718ec-d7fe-4880-b487-11e27ed9aa08" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.321018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abc718ec-d7fe-4880-b487-11e27ed9aa08" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.321018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abc718ec-d7fe-4880-b487-11e27ed9aa08" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.321018] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abc718ec-d7fe-4880-b487-11e27ed9aa08',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.375078] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.414303] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 728.414516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.414960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.415189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.415378] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.415500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.416093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.416093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.416093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.416093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.416093] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.416286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.416286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.416375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.416672] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.416672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.416672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.416877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.416877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.416877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.417053] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.417895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.417993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.418104] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.418202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.418259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.418433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.418508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.418591] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.720631] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.720930] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.721081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.721582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.721770] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.721969] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 73cd5e67-5183-4956-b6c0-23c949cedfbd not found, creating... [ 728.722292] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.722511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.722600] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.722839] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.722978] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.723289] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.723446] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.723558] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.723844] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.723999] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.724162] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 73cd5e67-5183-4956-b6c0-23c949cedfbd is going to be created. [ 728.749951] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.750233] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.750362] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.751251] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.751251] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.751251] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-73cd5e67-5183-4956-b6c0-23c949cedfbd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.826604] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abc718ec-d7fe-4880-b487-11e27ed9aa08 [ 728.826922] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.827154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.827192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.827467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.827599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.827726] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abc718ec-d7fe-4880-b487-11e27ed9aa08 already deleted. [ 728.827831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abc718ec-d7fe-4880-b487-11e27ed9aa08" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.878425] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.878929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.878929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.879534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.879703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.879861] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be created. [ 728.920463] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37b81f40-c340-4f5d-8250-ce4f8efa78fe: rpc.has_security_group_logging(os_id): False [ 728.921699] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.925248] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.925248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.925248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.925248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.925248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.939220] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: UNINITIALIZED for 2s [ 728.947403] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.947594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.947690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.947970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.948113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.948356] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.948653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.948755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.949401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.949401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.949401] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.949573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.949605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.949738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.949822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.950062] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.950179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.950446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.950446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.950519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.950550] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be created. [ 729.121062] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.121062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.121062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.121349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.121435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.139257] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 729.426604] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.551619] env[65161]: INFO networking_nsxv3.common.synchronization [req-5a872d71-903e-4eb7-a41c-aa16425d4871 req-457e3763-51b5-4774-ba3d-d426e831f326 service nova] Enqueued Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_rules [ 729.551812] env[65161]: INFO networking_nsxv3.common.synchronization [req-5a872d71-903e-4eb7-a41c-aa16425d4871 req-457e3763-51b5-4774-ba3d-d426e831f326 service nova] Enqueued Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_members [ 729.552203] env[65161]: INFO networking_nsxv3.common.synchronization [req-5a872d71-903e-4eb7-a41c-aa16425d4871 req-457e3763-51b5-4774-ba3d-d426e831f326 service nova] Enqueued Resource ID: 73cd5e67-5183-4956-b6c0-23c949cedfbd with Priority: HIGHEST for action port [ 729.553497] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_rules [ 729.553706] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_members [ 729.556226] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cd5e67-5183-4956-b6c0-23c949cedfbd with Priority: HIGHEST for action port [ 729.556616] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.556756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.556827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.557050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.557133] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.558159] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24f796e-b77b-42f0-a7c2-ae92228b28c5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.558337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.558337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.558530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.558682] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.558776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.558835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.558976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.560927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.561072] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.562301] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-73cd5e67-5183-4956-b6c0-23c949cedfbd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.562301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73cd5e67-5183-4956-b6c0-23c949cedfbd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.562605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73cd5e67-5183-4956-b6c0-23c949cedfbd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.562726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73cd5e67-5183-4956-b6c0-23c949cedfbd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.562726] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73cd5e67-5183-4956-b6c0-23c949cedfbd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.918302] env[65161]: INFO networking_nsxv3.common.synchronization [req-3be7ec3c-b367-4f10-93be-d9f7855eb2e5 req-0fee227e-854e-4358-addc-3ae5b49f91ce tempest-FloatingIPsAssociationNegativeTestJSON-497829059 tempest-FloatingIPsAssociationNegativeTestJSON-497829059-project-member] Enqueued Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGHEST for action security_group_members [ 729.918302] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGHEST for action security_group_members [ 729.918302] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d23f6bd-c3d6-4abc-b853-77560027d5d9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.918302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.918302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.918847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.919433] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.919564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.919619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.919811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.919896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.919998] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.929257] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.929257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.929972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.930307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.930446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.930548] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 729.964706] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.964706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.964706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.964706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.964706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.973637] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 730.064503] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24f796e-b77b-42f0-a7c2-ae92228b28c5 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.064858] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.065137] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.066126] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73cd5e67-5183-4956-b6c0-23c949cedfbd with status ACTIVE [ 730.067146] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.067146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.067146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.067146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.067146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.067384] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.067483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.067483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.067641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.067739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.068022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.068161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.068220] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.068417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.069031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.069031] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73cd5e67-5183-4956-b6c0-23c949cedfbd is going to be updated. [ 730.097843] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.097843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.097843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.098191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.098191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.098285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73cd5e67-5183-4956-b6c0-23c949cedfbd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.330572] env[65161]: INFO networking_nsxv3.common.synchronization [req-6309217d-9baa-4d84-a75b-4f6bf8e9ecc7 req-785dbcab-11a0-4e38-9fdb-d49da373b703 tempest-ServerExternalEventsTest-985681375 tempest-ServerExternalEventsTest-985681375-project-member] Enqueued Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGHEST for action security_group_members [ 730.332060] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGHEST for action security_group_members [ 730.332421] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7980d5f-c7aa-4292-9189-bc351c994c0f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.332619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.332619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.332826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.332977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.333558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.333558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.333558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.333558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.333558] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.422407] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.422587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.422660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.422877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.422973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.423183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.423282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.423344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.423546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.423645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.423736] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 is going to be updated. [ 730.452573] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.452920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.452920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.453054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.453226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.464278] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 in Status: IN_PROGRESS for 2s [ 730.502492] env[65161]: INFO networking_nsxv3.common.synchronization [req-19bddca7-68ba-4235-891a-ee154d034f0a req-f0b665f0-5387-438f-888f-69458ea422ff tempest-FloatingIPsAssociationTestJSON-2068989689 tempest-FloatingIPsAssociationTestJSON-2068989689-project-member] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 730.503090] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 730.503438] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.503617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.503762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.503936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.504114] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.504204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.504260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.504480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.504613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.504702] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.571351] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.837766] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.837766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.837766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.837766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.837766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.837766] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.837766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.837766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.837766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.837766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.837766] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7980d5f-c7aa-4292-9189-bc351c994c0f is going to be updated. [ 730.869694] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.869694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.869694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.869694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.869694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.878867] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7980d5f-c7aa-4292-9189-bc351c994c0f in Status: IN_PROGRESS for 2s [ 730.952427] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 730.952747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.953044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.953255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.953510] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.953737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.953790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.953976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.954165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.954326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.954518] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.007933] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.029543] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.029742] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.029863] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.030146] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.030390] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.030542] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.030699] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.030946] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.031341] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.031618] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.031760] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.031838] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.031955] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.032103] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.032173] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.032301] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.055231] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.055415] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.055592] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.055832] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.056318] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.056875] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.056999] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.057346] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.057472] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.073755] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.073999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.073999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.074209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.074301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.074400] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 is going to be created. [ 731.102670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.102947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.102947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.103104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.103265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.115442] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 in Status: UNINITIALIZED for 2s [ 731.154910] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 731.155164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.155352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.155607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.155700] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.458379] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.458836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.458836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.458923] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.459104] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.459265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.459355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.459611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.459688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.459829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.459934] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.460042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.460108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.460275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.460425] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.460576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.460576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.460827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.460827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.460908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.460950] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.511320] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.559970] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.560148] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.560275] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.560569] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.560719] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.561010] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e not found, creating... [ 731.561144] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.561455] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.561455] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.561633] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.561828] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.562041] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.562231] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.562289] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.562489] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.562632] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.562767] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e is going to be created. [ 731.584852] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.585074] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.585195] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.585467] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.585692] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.585889] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.658432] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.658563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.965981] env[65161]: INFO networking_nsxv3.common.synchronization [req-136527dd-e170-49e3-99a7-a1f4167a2b55 req-c77568d4-7851-4000-9763-3e13891d05fb tempest-VolumesAssistedSnapshotsTest-154839452 tempest-VolumesAssistedSnapshotsTest-154839452-project-member] Enqueued Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_members [ 731.965981] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeec6a6a-0263-4e7c-aea8-f50dc769d7fd: rpc.has_security_group_logging(os_id): False [ 731.965981] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGHEST for action security_group_members [ 731.966310] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-3151ee71-d6fa-4cda-bd22-0038b5e588ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.966569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.966569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.966666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.967444] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.967444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.967444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.967444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.967444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.967444] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.984439] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 731.984647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.986139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.986139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.986139] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.986139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.986139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.986139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.986139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.986139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.986139] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.988835] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.989248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.989248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.989248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.989459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.989459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.989571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.989945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.990237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.991751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.991751] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.991751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.991751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.991751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.991751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.991751] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.992125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.992125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.992684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.992684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.992684] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be created. [ 732.014449] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.014656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.014729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.014980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.015094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.015190] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 is going to be updated. [ 732.042537] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.042537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.042709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.043254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.043254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.052108] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: IN_PROGRESS for 2s [ 732.065019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.065019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.065019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.065019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.065019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.071350] env[65161]: INFO networking_nsxv3.common.synchronization [None req-80448d44-e9db-45d2-8f6d-bef399a56007 None None] Enqueued Resource ID: 77607da3-67a6-4e24-b775-909e67526194 with Priority: HIGHEST for action port [ 732.072512] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77607da3-67a6-4e24-b775-909e67526194 with Priority: HIGHEST for action port [ 732.072512] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-77607da3-67a6-4e24-b775-909e67526194 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.072512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77607da3-67a6-4e24-b775-909e67526194" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.072686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77607da3-67a6-4e24-b775-909e67526194" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.072830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77607da3-67a6-4e24-b775-909e67526194" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.072908] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77607da3-67a6-4e24-b775-909e67526194',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.083239] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 732.345314] env[65161]: INFO networking_nsxv3.common.synchronization [req-19bddca7-68ba-4235-891a-ee154d034f0a req-c72b6b63-f3e7-4897-898b-890948f884e5 service nova] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_rules [ 732.345314] env[65161]: INFO networking_nsxv3.common.synchronization [req-19bddca7-68ba-4235-891a-ee154d034f0a req-c72b6b63-f3e7-4897-898b-890948f884e5 service nova] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 732.345314] env[65161]: INFO networking_nsxv3.common.synchronization [req-19bddca7-68ba-4235-891a-ee154d034f0a req-c72b6b63-f3e7-4897-898b-890948f884e5 service nova] Enqueued Resource ID: 109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e with Priority: HIGHEST for action port [ 732.345314] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_rules [ 732.345314] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 732.345314] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e with Priority: HIGHEST for action port [ 732.345970] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.346430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.346665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.347156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.347418] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.348718] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.349924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.349924] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.351024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.351024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.351024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.351024] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.470834] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.471205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.471205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.471705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.471705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.471830] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.471989] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.472144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.472410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.472547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.473287] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee is going to be updated. [ 732.477145] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 in Status: SUCCESS [ 732.477540] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 deletion is rescheduled due to dependency. [ 732.477674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.495289] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.495600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.495670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.495899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.496098] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.496208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.496273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.496435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.496524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.496614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.496842] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.496961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.497042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.497240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.497385] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.497479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.497542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.497698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.497790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.497884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.497981] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.504654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.505102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.505193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.505980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.505980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.515611] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee in Status: IN_PROGRESS for 2s [ 732.575996] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77607da3-67a6-4e24-b775-909e67526194 [ 732.576269] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.578044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.578044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.578044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.578044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.578044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77607da3-67a6-4e24-b775-909e67526194 already deleted. [ 732.578044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77607da3-67a6-4e24-b775-909e67526194" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.857808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.857808] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e with status ACTIVE [ 732.857808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.857808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.857808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.857808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.858802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.858802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.858802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.858802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.858802] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e is going to be updated. [ 732.889138] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.889367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.889982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.889982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.889982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.889982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-109c39d1-3bae-46cc-bfdf-c29a7b5c8c3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.890991] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7980d5f-c7aa-4292-9189-bc351c994c0f in Status: SUCCESS [ 732.891109] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7980d5f-c7aa-4292-9189-bc351c994c0f deletion is rescheduled due to dependency. [ 732.891159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.001903] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37b81f40-c340-4f5d-8250-ce4f8efa78fe: rpc.has_security_group_logging(os_id): False [ 733.028955] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.029609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.029719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.030063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.030253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.030600] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.030801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.030870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.031083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.031166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.031372] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.031997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.032160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.032447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.032611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.033124] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.033517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.033517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.033517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.033517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.033942] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 733.121237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.121237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.121237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.121237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.121237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.130493] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 in Status: SUCCESS [ 733.130761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.130937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.131165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.131428] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.131582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.131623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.131820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.131916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.132017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.132139] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.134922] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 733.634653] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.062922] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: SUCCESS [ 734.063244] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.063364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.063541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.063726] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.063936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.063936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.064181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.064181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.064361] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.096138] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 734.096409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.138325] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e24f796e-b77b-42f0-a7c2-ae92228b28c5: rpc.has_security_group_logging(os_id): False [ 734.157368] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.157662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.157662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.157782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.157828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.158057] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.158204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.158259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.158430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.158430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.158879] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 is going to be created. [ 734.220183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.220299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.220363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.220581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.220786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.232236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 in Status: IN_PROGRESS for 2s [ 734.256864] env[65161]: INFO networking_nsxv3.common.synchronization [None req-74a07316-9666-41d5-b34f-d08e07ae346d tempest-AttachVolumeTestJSON-1674268260 tempest-AttachVolumeTestJSON-1674268260-project-member] Enqueued Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_rules [ 734.257150] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_rules [ 734.257509] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb437f4e-1421-44f7-a301-63abddb16aa0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.257797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.257797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.257940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.258030] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.428195] env[65161]: INFO networking_nsxv3.common.synchronization [None req-41338bd3-f5a7-4c85-a090-657122272a91 None None] Enqueued Resource ID: fe384183-e8d1-49c1-bc75-75d89be5c3f9 with Priority: HIGHEST for action port [ 734.428779] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe384183-e8d1-49c1-bc75-75d89be5c3f9 with Priority: HIGHEST for action port [ 734.429834] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe384183-e8d1-49c1-bc75-75d89be5c3f9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.430042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe384183-e8d1-49c1-bc75-75d89be5c3f9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.430160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe384183-e8d1-49c1-bc75-75d89be5c3f9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.430661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe384183-e8d1-49c1-bc75-75d89be5c3f9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.430811] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe384183-e8d1-49c1-bc75-75d89be5c3f9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.530619] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee in Status: SUCCESS [ 734.530797] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee deletion is rescheduled due to dependency. [ 734.530935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.533052] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-42ca7412-7e90-4e4e-a9e3-dcc9e48e4af0 tempest-ListServersNegativeTestJSON-1190994513 tempest-ListServersNegativeTestJSON-1190994513-project-member] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 734.533977] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 734.533977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.533977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.533977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.534270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.534451] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.534594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.534660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.534844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.535038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.535038] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.567253] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.705023] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7f536de5-c605-4e8e-9f88-94eee8e1d32d tempest-AttachVolumeTestJSON-1674268260 tempest-AttachVolumeTestJSON-1674268260-project-member] Enqueued Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_rules [ 734.705023] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_rules [ 734.706183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb437f4e-1421-44f7-a301-63abddb16aa0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.706183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.781096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.781096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.781096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.781096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.781096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.781096] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb437f4e-1421-44f7-a301-63abddb16aa0 already deleted. [ 734.781096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.781096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.781096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.781096] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.933246] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe384183-e8d1-49c1-bc75-75d89be5c3f9 [ 734.933493] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.933709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.933826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.934096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.934197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.934304] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe384183-e8d1-49c1-bc75-75d89be5c3f9 already deleted. [ 734.937025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe384183-e8d1-49c1-bc75-75d89be5c3f9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.040522] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.040695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.040756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.041259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.041363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.043438] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.043585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.043963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.044233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.044335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.044598] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 already deleted. [ 735.044634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.051343] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-645 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.051543] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.051652] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.051964] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.052239] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.052393] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.052508] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.052723] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.052864] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.055704] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.055704] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.055704] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.055704] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.055704] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.055704] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.055704] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.068700] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.086134] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.086977] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.087653] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.087889] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.088256] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-05309f25-a983-4b28-8a48-5eafbc697ede taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.088436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-05309f25-a983-4b28-8a48-5eafbc697ede" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.088553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-05309f25-a983-4b28-8a48-5eafbc697ede" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.088878] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-05309f25-a983-4b28-8a48-5eafbc697ede" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.091064] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05309f25-a983-4b28-8a48-5eafbc697ede',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.155379] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 735.155776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.155975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.156263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.156358] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.317489] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.317489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.317489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.317489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.317489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.317489] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb437f4e-1421-44f7-a301-63abddb16aa0 already deleted. [ 735.317489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.572028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.572179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.572961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.572961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.572961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.572961] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 is going to be updated. [ 735.594935] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.595099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.595228] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.595847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.595847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.596102] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 05309f25-a983-4b28-8a48-5eafbc697ede not found, creating... [ 735.596479] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.596677] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.596826] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.597448] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.598352] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.598352] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.598352] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.598352] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.598834] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.599024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.599211] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 05309f25-a983-4b28-8a48-5eafbc697ede is going to be created. [ 735.617845] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.618135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.618253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.618519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.619919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.628793] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.629135] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.629325] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.629724] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.629971] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.630309] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-05309f25-a983-4b28-8a48-5eafbc697ede" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.635287] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: IN_PROGRESS for 2s [ 735.658710] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.658952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.658952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.659270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.659485] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.659673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.659673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.659819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.659914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.659914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.660126] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.162659] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.162997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.162997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.163214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.163399] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.163517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.163586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.163745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.163927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.163927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.164071] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.164206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.164263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.164409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.164553] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.164644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.164770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.164872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.165082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.165082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.165202] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.247213] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 in Status: SUCCESS [ 736.247531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.379031] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-0ae87928-8bf8-47f0-a830-5e9813f00ef5 service nova] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_rules [ 736.380480] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-0ae87928-8bf8-47f0-a830-5e9813f00ef5 service nova] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 736.380480] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-0ae87928-8bf8-47f0-a830-5e9813f00ef5 service nova] Enqueued Resource ID: 05309f25-a983-4b28-8a48-5eafbc697ede with Priority: HIGHEST for action port [ 736.384613] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_rules [ 736.384613] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 736.384613] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05309f25-a983-4b28-8a48-5eafbc697ede with Priority: HIGHEST for action port [ 736.384613] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.384613] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.384613] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.384613] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.384613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.384613] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.387964] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-05309f25-a983-4b28-8a48-5eafbc697ede taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.388112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05309f25-a983-4b28-8a48-5eafbc697ede" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.388183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05309f25-a983-4b28-8a48-5eafbc697ede" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.388631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05309f25-a983-4b28-8a48-5eafbc697ede" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.388631] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05309f25-a983-4b28-8a48-5eafbc697ede',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.667545] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37b81f40-c340-4f5d-8250-ce4f8efa78fe: rpc.has_security_group_logging(os_id): False [ 736.687608] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.687900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.688055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.688252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.688368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.689564] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.689779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.689827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.690032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.690120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.690334] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.690436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.690513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.690643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.690761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.690931] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.691529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.691625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.691785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.691881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.691964] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 736.764111] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.764322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.764322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.764538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.764743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.784473] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 736.890688] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.890688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.890921] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.891749] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05309f25-a983-4b28-8a48-5eafbc697ede with status ACTIVE [ 736.891994] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.892096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.893311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.893311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.893311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.893311] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.893311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.893311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.893311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.893311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.893311] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.894126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.894126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.894126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.894126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.894126] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05309f25-a983-4b28-8a48-5eafbc697ede is going to be updated. [ 736.921290] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.921290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.921290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.921290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.921290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.921290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05309f25-a983-4b28-8a48-5eafbc697ede" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.924909] env[65161]: INFO networking_nsxv3.common.synchronization [req-f32e1315-e8ac-4124-b111-7954b8dc05f2 req-8970aa88-af3e-453b-aefb-62add10feb70 tempest-ServerPasswordTestJSON-702433198 tempest-ServerPasswordTestJSON-702433198-project-member] Enqueued Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGHEST for action security_group_members [ 736.925486] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGHEST for action security_group_members [ 736.925807] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-86add6f1-e722-4f5b-89cc-222fed23d419 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.926515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.926515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.926515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.926515] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.926515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.926515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.926780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.926780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.926780] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.328030] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-f6a47c9c-f2d7-47df-ad22-d8ae07efa1bd tempest-ListServersNegativeTestJSON-1190994513 tempest-ListServersNegativeTestJSON-1190994513-project-member] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 737.328580] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 737.328866] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.328967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.396033] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.430438] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.430594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.430722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.431048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.431155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.431362] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.431495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.431539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.431677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.431784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.431903] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86add6f1-e722-4f5b-89cc-222fed23d419 is going to be updated. [ 737.467776] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.468023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.468023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.468823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.468823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.477276] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86add6f1-e722-4f5b-89cc-222fed23d419 in Status: IN_PROGRESS for 2s [ 737.650765] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: SUCCESS [ 737.652624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.652624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.652624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.652624] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.652624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.652624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.652624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.652624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.652624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.652624] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.746357] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-645 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.746644] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.746851] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.747146] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.747410] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.747643] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.747825] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.748069] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.748235] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.748431] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.748551] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.748672] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.748804] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.748955] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.749110] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.749300] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.779074] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.779074] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.779074] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.779556] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.779556] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.779773] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.779918] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.780318] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.780453] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfc09662-3eff-409f-82e8-0b31fb8ce5b4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.902395] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.902614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.902690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.902927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.903052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.903166] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be created. [ 737.931045] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.931300] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.931383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.931710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.931872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.943739] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: UNINITIALIZED for 2s [ 738.157783] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.158042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.158042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.158774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.158774] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.158774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.158774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.159162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.159162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.159365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.159619] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.159707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.159754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.159881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.160045] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.160147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.160211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.160371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.160505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.160646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.160751] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.283574] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.283904] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.284127] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.284491] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.284716] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.284906] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port bfc09662-3eff-409f-82e8-0b31fb8ce5b4 not found, creating... [ 738.285327] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.285555] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.285724] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.288118] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.288398] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.288787] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.288966] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.289099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.289342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.289511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.289687] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: bfc09662-3eff-409f-82e8-0b31fb8ce5b4 is going to be created. [ 738.315241] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.315501] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.315848] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.316209] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.316476] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.316787] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.413557] env[65161]: INFO networking_nsxv3.common.synchronization [req-993951df-542f-4e12-9a3f-f166edb061b9 req-c97d8046-6d59-41e6-9bda-d68a0a599bfa tempest-ServersAdminNegativeTestJSON-1398107905 tempest-ServersAdminNegativeTestJSON-1398107905-project-member] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 738.414554] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 738.414906] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.415085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.415085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.415288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.415885] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.415885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.415885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.415885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.415885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.415885] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.664259] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa3f13db-d36f-47b7-bca4-30b32f714725: rpc.has_security_group_logging(os_id): False [ 738.684465] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.684754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.684754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.684896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.684992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.685193] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.685311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.685372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.685486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.685546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.685740] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.685879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.685879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.686055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.686120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.686299] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.686389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.686440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.686577] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.686652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.686736] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 is going to be updated. [ 738.747734] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.747900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.747977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.748188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.748335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.763919] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: IN_PROGRESS for 2s [ 738.803498] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 738.803804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.899073] env[65161]: INFO networking_nsxv3.common.synchronization [req-d7fd5ee2-b0ee-463e-8c7b-4f72500a24cb req-2f5d862b-bfbc-4429-bd7e-8d6ef6cc38f3 tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 738.899326] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 738.899690] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.899835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.899913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.900160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.900321] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.900450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.900517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.900704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.900802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.900898] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.918526] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.105874] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-77bd096a-154f-4c38-ba98-58b5245ed470 service nova] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_rules [ 739.106111] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-77bd096a-154f-4c38-ba98-58b5245ed470 service nova] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 739.106294] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-77bd096a-154f-4c38-ba98-58b5245ed470 service nova] Enqueued Resource ID: bfc09662-3eff-409f-82e8-0b31fb8ce5b4 with Priority: HIGHEST for action port [ 739.106972] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_rules [ 739.109791] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 739.112781] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfc09662-3eff-409f-82e8-0b31fb8ce5b4 with Priority: HIGHEST for action port [ 739.112781] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.112781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.112781] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.112781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.112781] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.112781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.112781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.113864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.113864] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfc09662-3eff-409f-82e8-0b31fb8ce5b4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.402952] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.403164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.403245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.403505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.403636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.403855] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.403988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.404070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.404236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.404317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.404444] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 739.421895] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.441559] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.441720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.441797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.442029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.442444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.452325] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 739.476842] env[65161]: INFO networking_nsxv3.common.synchronization [req-297eb962-cb7a-4e83-824a-c456dde72011 req-d92b0472-1489-4e1f-8b2e-ed851cd9b275 tempest-ImagesOneServerTestJSON-1053652074 tempest-ImagesOneServerTestJSON-1053652074-project-member] Enqueued Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGHEST for action security_group_members [ 739.477599] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGHEST for action security_group_members [ 739.479155] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb265379-c4fb-47cf-afb5-2c655df91dbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.479415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.479550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.479929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.480199] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.480357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.480457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.481156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.481305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.481501] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.494077] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86add6f1-e722-4f5b-89cc-222fed23d419 in Status: SUCCESS [ 739.494290] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86add6f1-e722-4f5b-89cc-222fed23d419 deletion is rescheduled due to dependency. [ 739.494425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.615099] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfc09662-3eff-409f-82e8-0b31fb8ce5b4 with status ACTIVE [ 739.615381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.615525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.615598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.615821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.615912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.616112] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.616260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.616358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.616584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.616810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.617115] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.617268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.617376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.617707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.617829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.617944] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfc09662-3eff-409f-82e8-0b31fb8ce5b4 is going to be updated. [ 739.644587] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.644587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.644587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.644818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.645871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.645871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfc09662-3eff-409f-82e8-0b31fb8ce5b4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.926887] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.926887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.929658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.930052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.930289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.930511] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce is going to be updated. [ 739.955999] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 739.955999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.955999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.955999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.955999] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.955999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.955999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.955999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.955999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.956469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.956469] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.959279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.959279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.960933] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.961197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.961276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.961545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.961644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.961789] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.970505] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.971184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.971184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.971184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.971184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.982722] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: IN_PROGRESS for 2s [ 739.984960] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.986147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.986346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.986574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.986719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.986877] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.987048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.987186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.987402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.988067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.988219] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb265379-c4fb-47cf-afb5-2c655df91dbf is going to be updated. [ 740.022350] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.022595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.022595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.022945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.023430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.043411] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb265379-c4fb-47cf-afb5-2c655df91dbf in Status: IN_PROGRESS for 2s [ 740.105954] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-bc95f423-0a63-4fc5-983c-3b2dc262167d tempest-ListServersNegativeTestJSON-1190994513 tempest-ListServersNegativeTestJSON-1190994513-project-member] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 740.105954] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 740.105954] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.105954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.277794] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fa9c299-1805-483b-9063-7c6b60f09be2 req-07c09a8a-ed0f-4715-928b-b86cd2e03205 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 740.278018] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fa9c299-1805-483b-9063-7c6b60f09be2 req-07c09a8a-ed0f-4715-928b-b86cd2e03205 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 740.278512] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 740.278644] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 740.278922] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.279837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.279881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.280951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.280951] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.280951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.280951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.280951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.281321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.281460] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.283987] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.285020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.285020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.285020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.285020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.285020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.285020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.285020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.285020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.285354] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.331206] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fa9c299-1805-483b-9063-7c6b60f09be2 req-07c09a8a-ed0f-4715-928b-b86cd2e03205 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 740.331317] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fa9c299-1805-483b-9063-7c6b60f09be2 req-07c09a8a-ed0f-4715-928b-b86cd2e03205 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 740.331577] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fa9c299-1805-483b-9063-7c6b60f09be2 req-07c09a8a-ed0f-4715-928b-b86cd2e03205 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_rules [ 740.332183] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fa9c299-1805-483b-9063-7c6b60f09be2 req-07c09a8a-ed0f-4715-928b-b86cd2e03205 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 740.332183] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fa9c299-1805-483b-9063-7c6b60f09be2 req-07c09a8a-ed0f-4715-928b-b86cd2e03205 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: a3e72240-027c-44dc-b13b-09d7387739a5 with Priority: HIGHEST for action port [ 740.332642] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 740.332811] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_rules [ 740.332891] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3e72240-027c-44dc-b13b-09d7387739a5 with Priority: HIGHEST for action port [ 740.332963] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 740.333079] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 740.334029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.334029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.334029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.334246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.334404] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.335669] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.335669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.335760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.336032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.336032] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.337108] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3e72240-027c-44dc-b13b-09d7387739a5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.337108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.337108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.337274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.337306] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3e72240-027c-44dc-b13b-09d7387739a5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.339411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.339411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.339411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.339411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.461165] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.461165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.471999] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.578424] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-645 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.578593] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.578717] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.578990] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.579348] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.579474] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.579629] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.579837] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.579982] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.580203] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.581027] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.581027] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.581027] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.581027] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.581027] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.581027] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.601902] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.602116] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.602273] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.602593] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-645" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.602768] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-eb353d68-a049-4de7-8fe8-80e939c49902 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.603456] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-eb353d68-a049-4de7-8fe8-80e939c49902" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.603456] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-eb353d68-a049-4de7-8fe8-80e939c49902" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.603456] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-eb353d68-a049-4de7-8fe8-80e939c49902" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.603600] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb353d68-a049-4de7-8fe8-80e939c49902',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.781320] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: SUCCESS [ 740.781555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.787469] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.788782] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.839812] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.839958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.840683] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.840683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.840683] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3e72240-027c-44dc-b13b-09d7387739a5 with status ACTIVE [ 740.840683] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.840683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.841201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.841201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.841201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.841304] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.841368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.841403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.842376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.842376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.842376] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.842376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.842376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.842376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.842376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.842376] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3e72240-027c-44dc-b13b-09d7387739a5 is going to be updated. [ 740.866609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.866755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.867393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.867393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.867393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.867393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.975430] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.106841] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.107115] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.107288] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.107650] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.107885] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.108124] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port eb353d68-a049-4de7-8fe8-80e939c49902 not found, creating... [ 741.108990] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.109189] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.109329] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.109605] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.109785] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.110189] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.110337] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.110452] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.110756] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.110918] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.111109] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: eb353d68-a049-4de7-8fe8-80e939c49902 is going to be created. [ 741.136080] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.136080] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.136367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.136481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.136747] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.137121] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-eb353d68-a049-4de7-8fe8-80e939c49902" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.290127] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.291328] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.464336] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 741.464672] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b deletion is rescheduled due to dependency. [ 741.464672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.479614] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.479798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.479883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.480159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.480271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.480379] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 741.516681] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.516855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.516936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.517863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.518048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.528472] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 741.796022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.796022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.796022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.796022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.796022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.796022] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 741.796022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.796022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.796022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.796022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.796022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.796678] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be created. [ 741.834255] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.834255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.834255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.834255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.834255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.837603] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.838065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.838298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.838673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.838995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.852432] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: UNINITIALIZED for 2s [ 741.852432] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 741.864959] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-f509eb1f-a08f-4b32-8f80-33bfcc624af4 service nova] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_rules [ 741.864959] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-f509eb1f-a08f-4b32-8f80-33bfcc624af4 service nova] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 741.864959] env[65161]: INFO networking_nsxv3.common.synchronization [req-d552ab6b-4edb-4db8-b658-42ea07c43468 req-f509eb1f-a08f-4b32-8f80-33bfcc624af4 service nova] Enqueued Resource ID: eb353d68-a049-4de7-8fe8-80e939c49902 with Priority: HIGHEST for action port [ 741.865879] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_rules [ 741.866201] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 741.866435] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb353d68-a049-4de7-8fe8-80e939c49902 with Priority: HIGHEST for action port [ 741.866847] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.867302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.867668] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.868041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.868433] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb353d68-a049-4de7-8fe8-80e939c49902 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.869956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb353d68-a049-4de7-8fe8-80e939c49902" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.869956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb353d68-a049-4de7-8fe8-80e939c49902" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.869956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb353d68-a049-4de7-8fe8-80e939c49902" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.869956] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb353d68-a049-4de7-8fe8-80e939c49902',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.996015] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: SUCCESS [ 741.997892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.053557] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb265379-c4fb-47cf-afb5-2c655df91dbf in Status: SUCCESS [ 742.053749] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb265379-c4fb-47cf-afb5-2c655df91dbf deletion is rescheduled due to dependency. [ 742.053859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.374414] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb353d68-a049-4de7-8fe8-80e939c49902 with status ACTIVE [ 742.374849] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.374849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.374974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.376377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.376377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.376377] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.376377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.376377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.376377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.376377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.376377] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.376805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.376986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.377217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.377298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.377553] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb353d68-a049-4de7-8fe8-80e939c49902 is going to be updated. [ 742.381874] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 742.381874] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 with Priority: HIGHEST for action security_group_members [ 742.384579] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 742.385820] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 742.385820] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 with Priority: HIGHEST for action security_group_members [ 742.385820] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 742.387839] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.387839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.387839] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b59bd654-2015-4855-bb01-60ad0a84a0b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.387839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.387839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.387839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.387839] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.387839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.387839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.387839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.387839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.387839] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.390715] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.390715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.407484] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.408111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.408111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.408111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.408254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.408354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb353d68-a049-4de7-8fe8-80e939c49902" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.443312] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 742.443490] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 742.443622] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_rules [ 742.445010] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 742.445263] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 with Priority: HIGHEST for action security_group_rules [ 742.445402] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 with Priority: HIGHEST for action security_group_members [ 742.445541] env[65161]: INFO networking_nsxv3.common.synchronization [req-3545b5d3-fbbe-42c0-9a3d-e23936a415f7 req-5891a586-febb-4977-85f4-959b845f368e tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: a3e72240-027c-44dc-b13b-09d7387739a5 with Priority: HIGHEST for action port [ 742.446171] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 742.446319] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_rules [ 742.446420] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 with Priority: HIGHEST for action security_group_members [ 742.446516] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3e72240-027c-44dc-b13b-09d7387739a5 with Priority: HIGHEST for action port [ 742.446598] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 with Priority: HIGHEST for action security_group_rules [ 742.446689] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 742.446774] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 742.447064] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.447171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.447360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.447441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.447614] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b59bd654-2015-4855-bb01-60ad0a84a0b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.447697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.447872] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3e72240-027c-44dc-b13b-09d7387739a5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.448068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.448068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.448628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.448628] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3e72240-027c-44dc-b13b-09d7387739a5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.449294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b59bd654-2015-4855-bb01-60ad0a84a0b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.449404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.449466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.449706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.449776] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.450584] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.450748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.450910] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.451152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.893392] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.952659] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3e72240-027c-44dc-b13b-09d7387739a5 with status ACTIVE [ 742.952904] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.953058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.953142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.953346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.953453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.953615] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.953714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.953826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.954979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.954979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.954979] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.955190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.955283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.955574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.955860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.955993] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3e72240-027c-44dc-b13b-09d7387739a5 is going to be updated. [ 742.957519] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b59bd654-2015-4855-bb01-60ad0a84a0b0 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.957642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.979019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.979194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.979294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.979590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.979799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.980032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3e72240-027c-44dc-b13b-09d7387739a5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.397109] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.542018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 743.542387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.542804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.543045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.543647] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.543647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.543647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.543647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.543647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.543976] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.869133] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 743.869331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.869954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.870264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.870502] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.870576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.870647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.870808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.870903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.871065] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.874664] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: SUCCESS [ 743.874664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.874664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.874664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.875642] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.875788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.875857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.876954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.876954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.876954] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.900249] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.900249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.900249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.903842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.903842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.903842] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 is going to be created. [ 743.932707] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.932935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.932984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.933456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.933456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.953360] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 in Status: UNINITIALIZED for 2s [ 744.047196] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.063762] env[65161]: INFO networking_nsxv3.common.synchronization [req-a94de974-707c-4807-9cc9-7729f00cd975 req-8c88da8c-9d7a-4edf-9545-320e3dbbdba5 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 744.064526] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 744.064957] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.065241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.065349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.065696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.065957] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.066128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.066196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.066396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.066503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.066602] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.310301] env[65161]: INFO networking_nsxv3.common.synchronization [req-a94de974-707c-4807-9cc9-7729f00cd975 req-d120bf31-6263-4ebb-bdf2-979323eed730 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 744.310860] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 744.311535] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.311535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.374042] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.381741] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.552182] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.573358] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.591387] env[65161]: INFO networking_nsxv3.common.synchronization [req-a94de974-707c-4807-9cc9-7729f00cd975 req-7da6b667-97ea-48c7-8394-79281fd2d299 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 744.591991] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 744.592400] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.592537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.877614] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.883331] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.055051] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.055051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.055051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.056383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.056383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.056383] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 745.074562] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.089978] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.090157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.090196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.090848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.090848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.101666] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 745.385987] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.386179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.386905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.386905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.386905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.386905] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be updated. [ 745.387982] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.388104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.388166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.388346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.388430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.388519] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 745.424407] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.424634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.424697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.424987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.425193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.428074] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.428280] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.428368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.428683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.430711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.443572] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: IN_PROGRESS for 2s [ 745.444516] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 745.578094] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.578259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.578327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.578554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.578644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.578744] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 745.612358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.612644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.612644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.613900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.613900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.622933] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 745.965511] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 in Status: SUCCESS [ 745.968164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.968164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.968164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.968164] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.968164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.968164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.968164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.968164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.968164] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.271416] env[65161]: INFO networking_nsxv3.common.synchronization [None req-6b9a314f-34a4-4b89-b3bc-773afcdb68af None None] Enqueued Resource ID: 0f283404-1114-40c9-af6c-d1e1d4e33cef with Priority: HIGHEST for action port [ 746.272074] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f283404-1114-40c9-af6c-d1e1d4e33cef with Priority: HIGHEST for action port [ 746.273305] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f283404-1114-40c9-af6c-d1e1d4e33cef taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.273487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f283404-1114-40c9-af6c-d1e1d4e33cef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.273742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f283404-1114-40c9-af6c-d1e1d4e33cef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.275321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f283404-1114-40c9-af6c-d1e1d4e33cef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.275552] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f283404-1114-40c9-af6c-d1e1d4e33cef',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.471586] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.782770] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f283404-1114-40c9-af6c-d1e1d4e33cef [ 746.782770] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.782770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.782770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.783012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.783012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.783104] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f283404-1114-40c9-af6c-d1e1d4e33cef already deleted. [ 746.783197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f283404-1114-40c9-af6c-d1e1d4e33cef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.975383] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.114373] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 747.114748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.115047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.115393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.115751] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.116136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.116217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.116463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.116612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.116775] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.455690] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 747.456099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.456203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.456330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.457023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.457023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.457023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.457023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.457238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.457413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.457497] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.459244] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: SUCCESS [ 747.459431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.459647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.459754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.459929] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.460071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.460119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.460299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.460334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.460417] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.461655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.461655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.461655] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.461821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.461821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.463021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.463159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.465034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.465034] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.465034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.465034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.465034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.465034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.465498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.465498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.465498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.465498] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.479329] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.479510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.479575] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.479755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.480285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.480285] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 is going to be updated. [ 747.511799] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.512074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.512209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.512557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.512805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.523721] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 in Status: IN_PROGRESS for 2s [ 747.619341] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.634939] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 747.636524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.636524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.636524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.636524] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.636524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.636524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.636524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.636524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.636524] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.965167] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.965583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.965884] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.967483] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.972641] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.125500] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.139495] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.139733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.139813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.140113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.140217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.140423] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.140540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.140608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.140763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.140852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.140941] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 748.184617] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.186027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.186027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.186027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.186027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.200977] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 748.476542] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.476542] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b51ab0e8-12bd-4de0-9195-4b7a1c129654: rpc.has_security_group_logging(os_id): False [ 748.476542] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.495523] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.495698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.495736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.496076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.496076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.496332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.496433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.496487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.497111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.497111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.497111] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be created. [ 748.558902] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.558902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.558902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.558902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.558902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.574464] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: IN_PROGRESS for 2s [ 748.628608] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.628812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.628897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.629147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.629253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.629349] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 748.679899] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c35c5c75-d1cb-4e4b-b3fa-f2b1d14fb49c tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_rules [ 748.680505] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_rules [ 748.680863] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.680992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.681095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.681362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.681463] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.694128] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.694318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.694407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.694713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.694938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.710066] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 748.782126] env[65161]: INFO networking_nsxv3.common.synchronization [None req-dd1f574e-44c9-4fc5-9362-3f2e43eb81cb tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_rules [ 748.783495] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_rules [ 748.783495] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.784083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.904529] env[65161]: INFO networking_nsxv3.common.synchronization [None req-867a4172-20e4-4b91-8d21-fbc5cc806c63 None None] Enqueued Resource ID: 7408ba74-8f08-49bf-b33d-203e0def30e5 with Priority: HIGHEST for action port [ 748.905140] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7408ba74-8f08-49bf-b33d-203e0def30e5 with Priority: HIGHEST for action port [ 748.905929] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7408ba74-8f08-49bf-b33d-203e0def30e5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.906104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7408ba74-8f08-49bf-b33d-203e0def30e5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.906177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7408ba74-8f08-49bf-b33d-203e0def30e5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.906686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7408ba74-8f08-49bf-b33d-203e0def30e5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.906843] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7408ba74-8f08-49bf-b33d-203e0def30e5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.981926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.982137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.982240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.982550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.982688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.982859] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be updated. [ 748.985289] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.988022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.988022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.988022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.988022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.988022] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 749.031807] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.031999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.032087] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.032358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.033113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.035121] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.035607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.035607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.035607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.035607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.048071] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: IN_PROGRESS for 2s [ 749.048071] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 749.209530] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.209530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.209530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.209706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.209706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.209810] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 already deleted. [ 749.209865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.210026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.210187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.210270] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.409082] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7408ba74-8f08-49bf-b33d-203e0def30e5 [ 749.409337] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.409495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.409569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.409892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.409994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.410106] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7408ba74-8f08-49bf-b33d-203e0def30e5 already deleted. [ 749.410210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7408ba74-8f08-49bf-b33d-203e0def30e5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.536356] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 in Status: SUCCESS [ 749.539058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.539058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.539058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.539058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.539058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.539058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.539058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.539058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.539058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.539058] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.740185] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.740299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.741585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.741585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.741585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.741585] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 already deleted. [ 749.741585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.042418] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.214974] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 750.215368] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe deletion is rescheduled due to dependency. [ 750.215560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.215744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.215963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.216171] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.216291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.216356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.216521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.216604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.216908] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.545642] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b59bd654-2015-4855-bb01-60ad0a84a0b0: rpc.has_security_group_logging(os_id): False [ 750.568643] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.569085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.569192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.569439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.569579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.569838] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.569974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.570054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.570231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.570551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.570551] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 is going to be created. [ 750.593170] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: SUCCESS [ 750.594621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.595182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.595182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.595182] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.636394] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.636551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.636719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.637757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.637757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.655111] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 in Status: IN_PROGRESS for 2s [ 750.724294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.724547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.724691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.725946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.725946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.725946] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.725946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.725946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.725946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.725946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.726188] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 750.730952] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 750.731213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.731432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.731724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.733552] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.733552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.733552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.733552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.733552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.733552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.733552] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.733552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.733552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.734034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.734818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.735074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.735347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.735601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.735601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.735697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.735779] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.737036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.737352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.737554] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.737730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.737833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.740194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.740194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.740194] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.780674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.780905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.780905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.781177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.781295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.795659] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 751.066223] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: SUCCESS [ 751.066223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.066398] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 751.066670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.067382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.067678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.067942] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.068106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.068196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.068628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.068628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.068694] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.069874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.070176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.070442] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.070609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.070739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.070994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.071914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.072040] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.100022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.100237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.243430] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06af9b92-f2b2-48b1-bf38-8ca0713490e4: rpc.has_security_group_logging(os_id): False [ 751.244696] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.266385] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.266551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.266612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.266976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.267091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.267331] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.267601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.267601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.267691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.267722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.267884] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.267972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.268050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.268190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.268264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.268587] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.268587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.268587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.268783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.268783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.268855] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be created. [ 751.279196] env[65161]: INFO networking_nsxv3.common.synchronization [None req-aa2ade88-d129-4e1e-936a-bdd43144acfa None None] Enqueued Resource ID: b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0 with Priority: HIGHEST for action port [ 751.279812] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0 with Priority: HIGHEST for action port [ 751.280177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.280302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.280393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.280742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.280795] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.363883] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.364164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.364164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.364885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.364885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.391497] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 751.574963] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.575958] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.747797] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.785393] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0 [ 751.785596] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.785763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.790559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.790559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.790559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.790559] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0 already deleted. [ 751.790559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8a456ff-0ae2-4df5-99b4-a1a7d0b65eb0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.078698] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.079849] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.252733] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.252893] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.252959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.253192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.253835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.253835] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 752.286015] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.286169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.286241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.286453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.286600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.299188] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 752.582083] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.583143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.583143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.583143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.583143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.583143] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 752.586177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.586177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.586177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.586177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.586177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.586177] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be updated. [ 752.621298] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.621461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.621758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.622177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.622177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.624511] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.624738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.624738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.626292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.626292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.638093] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: IN_PROGRESS for 2s [ 752.639188] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 752.668133] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 in Status: SUCCESS [ 752.668360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.803576] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 752.804202] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe deletion is rescheduled due to dependency. [ 752.804202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.404818] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 753.407199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.407199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.407199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.407199] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.666120] env[65161]: INFO networking_nsxv3.common.synchronization [None req-67a5ebfd-578f-40d5-8233-eb9a91d33d81 None None] Enqueued Resource ID: 9f8ce1e5-5522-4a6b-9ebc-94b030d418a4 with Priority: HIGHEST for action port [ 753.666760] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f8ce1e5-5522-4a6b-9ebc-94b030d418a4 with Priority: HIGHEST for action port [ 753.667125] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f8ce1e5-5522-4a6b-9ebc-94b030d418a4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.667236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f8ce1e5-5522-4a6b-9ebc-94b030d418a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.667302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f8ce1e5-5522-4a6b-9ebc-94b030d418a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.667558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f8ce1e5-5522-4a6b-9ebc-94b030d418a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.667654] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f8ce1e5-5522-4a6b-9ebc-94b030d418a4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.909119] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.909119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.170084] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f8ce1e5-5522-4a6b-9ebc-94b030d418a4 [ 754.170329] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.170467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.170535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.170761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.170851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.171458] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f8ce1e5-5522-4a6b-9ebc-94b030d418a4 already deleted. [ 754.171458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f8ce1e5-5522-4a6b-9ebc-94b030d418a4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.312036] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 754.312286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.312463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.312691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.312886] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.313015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.313091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.313249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.313360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.313491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.313595] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.650300] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: SUCCESS [ 754.650534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.650736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.650960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.651169] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.651312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.651380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.651677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.651915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.651915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.652010] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.653613] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 754.653792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.653934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.654655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.654829] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.654941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.655023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.655303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.655303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.655364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.655477] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.655624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.655624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.655761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.655901] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.655994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.656061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.656198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.656273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.656352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.656464] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.816329] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.816821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.816821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.816821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.816914] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.817148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.817203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.817316] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.817488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.817488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.817627] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.817851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.817851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.817943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.818111] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.818179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.818224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.818639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.818639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.818639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.818639] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.874115] env[65161]: INFO networking_nsxv3.common.synchronization [req-8f7c9f61-04d8-4cb1-9d09-db57c0b6999b req-7435ad15-42f0-4d38-af07-f78593ba6281 tempest-FloatingIPsAssociationTestJSON-2068989689 tempest-FloatingIPsAssociationTestJSON-2068989689-project-member] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 754.874642] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 754.874937] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.875075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.875773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.875773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.875773] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.875773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.875773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.876020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.876020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.876020] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.160650] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.161670] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeec6a6a-0263-4e7c-aea8-f50dc769d7fd: rpc.has_security_group_logging(os_id): False [ 755.191816] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.191816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.191816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.191816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.191816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.191816] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.191816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.191816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.191816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.191816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.192152] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.192152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.192219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.192739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.192739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.192739] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.192739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.192739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.193265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.193265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.193265] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 755.287534] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.287711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.287774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.287977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.288148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.305020] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 755.320902] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06af9b92-f2b2-48b1-bf38-8ca0713490e4: rpc.has_security_group_logging(os_id): False [ 755.351327] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.351515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.351661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.351910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.351999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.352248] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.352591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.352591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.352591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.352745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.356022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.356022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.356022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.356022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.356022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.356022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.356022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.356022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.356022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.356022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.356022] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 755.378663] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.464931] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.465106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.465177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.465406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.465556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.481635] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 755.665499] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b51ab0e8-12bd-4de0-9195-4b7a1c129654: rpc.has_security_group_logging(os_id): False [ 755.684356] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.684514] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.685635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.685635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.685635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.685635] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.685635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.685635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.685635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.685635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.685635] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be updated. [ 755.755374] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.755589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.755690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.755986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.756185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.773825] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: IN_PROGRESS for 2s [ 755.880755] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.182939] env[65161]: INFO networking_nsxv3.common.synchronization [req-0d3a59ee-a3aa-4597-8b20-182629a43bb2 req-bd1ee759-dfae-4e3a-8b53-265fec7bff5a tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 756.183624] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 756.183967] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.184112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.184252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.184372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.184531] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.184634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.184927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.184927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.184927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.185105] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.205721] env[65161]: INFO networking_nsxv3.common.synchronization [req-0d3a59ee-a3aa-4597-8b20-182629a43bb2 req-bd1ee759-dfae-4e3a-8b53-265fec7bff5a tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 756.205891] env[65161]: INFO networking_nsxv3.common.synchronization [req-0d3a59ee-a3aa-4597-8b20-182629a43bb2 req-bd1ee759-dfae-4e3a-8b53-265fec7bff5a tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 756.206035] env[65161]: INFO networking_nsxv3.common.synchronization [req-0d3a59ee-a3aa-4597-8b20-182629a43bb2 req-bd1ee759-dfae-4e3a-8b53-265fec7bff5a tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with Priority: HIGHEST for action port [ 756.206487] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 756.206619] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 756.206740] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with Priority: HIGHEST for action port [ 756.208544] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.208712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.208789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.208987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.209091] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.209986] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.210098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.210293] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.210395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.210463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.210631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.210710] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff8b556-8b18-456a-b1a6-f2fecb63b1df',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.384434] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.384611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.384688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.384959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.385062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.385162] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 is going to be updated. [ 756.414318] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.414469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.414540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.414779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.414999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.424165] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: IN_PROGRESS for 2s [ 756.687063] env[65161]: INFO networking_nsxv3.common.synchronization [req-b2e7f520-75a3-4a9b-8461-916815b18b94 req-0bcc0efd-d61c-48a7-853e-faf40afce186 tempest-ListServersNegativeTestJSON-1190994513 tempest-ListServersNegativeTestJSON-1190994513-project-member] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 756.687592] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.691852] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 756.692491] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.692673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.692800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.692976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.693143] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.693258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.694765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.694765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.694765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.694765] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.714131] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.714131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.714131] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with status ACTIVE [ 756.714389] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.716304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.716304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.716304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.716304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.716304] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.716505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.718032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.718032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.718032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.718032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.718032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.718032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.718032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.718298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.718298] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df is going to be updated. [ 756.744669] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.744822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.744896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.745794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.745794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.745794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.193565] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.195293] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.328722] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 757.328934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.330012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.330383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.330563] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.503054] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 757.503054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.503054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.503054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.503054] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.696346] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.696513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.696610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.696953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.696953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.697079] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be updated. [ 757.699520] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.758879] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.758879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.758879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.758879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.759140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.772136] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: IN_PROGRESS for 2s [ 757.785850] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: SUCCESS [ 757.786092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.834261] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.835696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.835806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.836062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.836280] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.836418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.836509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.836701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.836823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.836919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.837021] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.006740] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.006740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.203673] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.203963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.203963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.204204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.204299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.204399] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 758.233442] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.233442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.233660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.233776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.233879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.244170] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 758.265693] env[65161]: INFO networking_nsxv3.common.synchronization [None req-b812f2c3-ae6a-4edb-a50d-523dc1f50e31 None None] Enqueued Resource ID: fecce5c7-bf9e-4276-b30b-06042c634a41 with Priority: HIGHEST for action port [ 758.266542] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fecce5c7-bf9e-4276-b30b-06042c634a41 with Priority: HIGHEST for action port [ 758.267047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-fecce5c7-bf9e-4276-b30b-06042c634a41 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.267188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fecce5c7-bf9e-4276-b30b-06042c634a41" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.267257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fecce5c7-bf9e-4276-b30b-06042c634a41" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.267515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fecce5c7-bf9e-4276-b30b-06042c634a41" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.267602] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fecce5c7-bf9e-4276-b30b-06042c634a41',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.324889] env[65161]: INFO networking_nsxv3.common.synchronization [req-06d24bff-ac6b-4184-af0f-cbb5640665ba req-0c5e5ea4-7729-4180-9494-a310a1983e7f tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 758.325687] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 758.325849] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.325936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.326334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.326795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.326892] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.327634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.327634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.327634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.327634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.327634] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.342020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.342020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.342020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.342020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.342020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.342020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.342020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.342020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.342020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.342020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.342020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.342780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.342780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.342780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.342780] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.342780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.342780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.342780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.342999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.342999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.342999] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.435907] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: SUCCESS [ 758.436398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.770425] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fecce5c7-bf9e-4276-b30b-06042c634a41 [ 758.770425] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.770425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.770425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.770425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.770425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.770644] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fecce5c7-bf9e-4276-b30b-06042c634a41 already deleted. [ 758.770644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fecce5c7-bf9e-4276-b30b-06042c634a41" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.781534] env[65161]: INFO networking_nsxv3.common.synchronization [None req-dfd08e5d-9d3a-44ee-8607-53e26449782c tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_rules [ 758.782211] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_rules [ 758.782532] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ba62457-a546-42c0-916a-d1efa9c77ee4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.782726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.782793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.783060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.783150] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.829841] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.830067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.830067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.830257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.830478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.830547] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.830645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.830707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.830853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.830928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.831027] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 758.836092] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.836279] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.836396] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.836628] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.836867] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.837026] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.837136] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.837331] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.837457] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.837654] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.837758] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.837857] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.837956] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.838083] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.838183] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.838304] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.848484] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeec6a6a-0263-4e7c-aea8-f50dc769d7fd: rpc.has_security_group_logging(os_id): False [ 758.858447] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.858665] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.858803] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.858973] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.859298] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-107f4985-18e7-4f07-9921-07987d2d2393 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.859468] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-107f4985-18e7-4f07-9921-07987d2d2393" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.859603] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-107f4985-18e7-4f07-9921-07987d2d2393" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.859965] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-107f4985-18e7-4f07-9921-07987d2d2393" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.860118] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107f4985-18e7-4f07-9921-07987d2d2393',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.866620] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.866755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.866920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.867368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.867561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.873358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.873485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.873561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.873860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.873860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.874034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.874135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.874200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.874346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.874425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.874618] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.874714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.874776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.874935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.875035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.875206] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.875302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.875357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.875522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.875592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.875681] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 758.877760] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 758.945216] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.945376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.945418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.945638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.945782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.977420] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 759.120965] env[65161]: INFO networking_nsxv3.common.synchronization [None req-df1f5231-9fef-45e2-a331-1ec00a835f32 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_rules [ 759.122035] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_rules [ 759.122035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ba62457-a546-42c0-916a-d1efa9c77ee4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.122035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.311072] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.313389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.313389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.313389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.313389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.313389] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 already deleted. [ 759.313389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.313389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.313389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.313389] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.364759] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.364759] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.364759] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.364759] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.364759] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.364759] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 107f4985-18e7-4f07-9921-07987d2d2393 not found, creating... [ 759.365028] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.365028] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.365115] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.365314] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.365443] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.365720] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.365871] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.365984] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.366207] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.366335] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.366470] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 107f4985-18e7-4f07-9921-07987d2d2393 is going to be created. [ 759.398490] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.398490] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.398490] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.398490] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.398849] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.399156] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-107f4985-18e7-4f07-9921-07987d2d2393" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.782278] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 759.782502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.782705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.782921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.783122] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.783241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.783302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.783594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.783594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.783782] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.835403] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.835586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.835660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.835872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.835961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.836067] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 already deleted. [ 759.836149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.106900] env[65161]: INFO networking_nsxv3.common.synchronization [req-5323a453-7cc5-49cf-b931-2eeed72e4172 req-073467d2-b1e9-45bf-a3e6-d1ef660552c3 tempest-MultipleCreateTestJSON-565628387 tempest-MultipleCreateTestJSON-565628387-project-member] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 760.107654] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 760.107923] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.108744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.108744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.108744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.108744] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.108744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.108744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.108990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.108990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.109062] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.132844] env[65161]: INFO networking_nsxv3.common.synchronization [req-06d24bff-ac6b-4184-af0f-cbb5640665ba req-8fd721de-3e0c-4d93-a391-587e695ecd2c service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 760.133029] env[65161]: INFO networking_nsxv3.common.synchronization [req-06d24bff-ac6b-4184-af0f-cbb5640665ba req-8fd721de-3e0c-4d93-a391-587e695ecd2c service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 760.133150] env[65161]: INFO networking_nsxv3.common.synchronization [req-06d24bff-ac6b-4184-af0f-cbb5640665ba req-8fd721de-3e0c-4d93-a391-587e695ecd2c service nova] Enqueued Resource ID: 107f4985-18e7-4f07-9921-07987d2d2393 with Priority: HIGHEST for action port [ 760.133366] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 760.134197] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 760.134197] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 107f4985-18e7-4f07-9921-07987d2d2393 with Priority: HIGHEST for action port [ 760.135724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.135921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.136040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.137533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.137533] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.138366] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.138495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.138650] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-107f4985-18e7-4f07-9921-07987d2d2393 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.138743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-107f4985-18e7-4f07-9921-07987d2d2393" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.138846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-107f4985-18e7-4f07-9921-07987d2d2393" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.138971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-107f4985-18e7-4f07-9921-07987d2d2393" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.139059] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('107f4985-18e7-4f07-9921-07987d2d2393',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.259829] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 760.260064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.260251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.260632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.260684] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.260794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.260907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.261015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.261106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.261226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.261285] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.288825] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.450436] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.450722] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.450722] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.450996] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.451258] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.451406] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.451516] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.451750] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.451888] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.452098] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.452208] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.452303] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.452403] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.452504] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.452607] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.452745] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.472311] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.472569] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.472753] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.472944] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.473289] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-29942cf3-e12e-4161-9d01-cac8fe521b02 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.473455] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-29942cf3-e12e-4161-9d01-cac8fe521b02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.474582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-29942cf3-e12e-4161-9d01-cac8fe521b02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.474582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-29942cf3-e12e-4161-9d01-cac8fe521b02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.474582] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29942cf3-e12e-4161-9d01-cac8fe521b02',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.611858] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.612166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.612285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.612635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.612784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.613077] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.613421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.613421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.613563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.613563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.614213] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa already deleted. [ 760.614336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.640813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.640813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.640957] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 107f4985-18e7-4f07-9921-07987d2d2393 with status ACTIVE [ 760.641128] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.641245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.641291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.641479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.641560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.641741] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.641831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.641889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.642049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.642123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.642296] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.643075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.643075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.643075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.643075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.643075] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 107f4985-18e7-4f07-9921-07987d2d2393 is going to be updated. [ 760.664221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.664357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.664454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.664610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.664744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.664897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-107f4985-18e7-4f07-9921-07987d2d2393" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.763976] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.764221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.764293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.767303] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.767303] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.767303] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.767303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.767303] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.791336] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.887947] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 760.888171] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 760.888308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.888481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.888701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.888884] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.889012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.889078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.889223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.889317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.889397] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.977060] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.977060] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.977060] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.977060] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.977384] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.977384] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 29942cf3-e12e-4161-9d01-cac8fe521b02 not found, creating... [ 760.977513] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.977663] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.977810] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.978019] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.978231] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.978527] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.978695] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.978792] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.978991] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.979158] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.979277] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 29942cf3-e12e-4161-9d01-cac8fe521b02 is going to be created. [ 760.997163] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 760.997497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.001635] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.001899] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.002054] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.002332] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.002610] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.002800] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-29942cf3-e12e-4161-9d01-cac8fe521b02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.269061] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06af9b92-f2b2-48b1-bf38-8ca0713490e4: rpc.has_security_group_logging(os_id): False [ 761.290582] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.290696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.290925] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.291661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.291661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.291661] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.291661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.291823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.291892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.291969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.292161] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.292254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.292982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.292982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.292982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.292982] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.292982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.292982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.292982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.293275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.293275] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 761.294544] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.294658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.294706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.294848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.294920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.295028] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be updated. [ 761.330115] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.330356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.330440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.330747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.330891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.341709] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: IN_PROGRESS for 2s [ 761.362354] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.362488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.362661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.362760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.363728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.382528] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 761.391966] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.713727] env[65161]: INFO networking_nsxv3.common.synchronization [req-5323a453-7cc5-49cf-b931-2eeed72e4172 req-f1d91d31-76ec-4cf4-b4a6-a67ab12ea76d service nova] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_rules [ 761.713994] env[65161]: INFO networking_nsxv3.common.synchronization [req-5323a453-7cc5-49cf-b931-2eeed72e4172 req-f1d91d31-76ec-4cf4-b4a6-a67ab12ea76d service nova] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 761.717592] env[65161]: INFO networking_nsxv3.common.synchronization [req-5323a453-7cc5-49cf-b931-2eeed72e4172 req-f1d91d31-76ec-4cf4-b4a6-a67ab12ea76d service nova] Enqueued Resource ID: 29942cf3-e12e-4161-9d01-cac8fe521b02 with Priority: HIGHEST for action port [ 761.718301] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_rules [ 761.718609] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 761.718609] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29942cf3-e12e-4161-9d01-cac8fe521b02 with Priority: HIGHEST for action port [ 761.718895] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.719059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.719172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.719588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.719588] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.720367] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.720481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.720548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.720716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.721282] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.721426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.721519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.721757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.721908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.722102] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.722861] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-29942cf3-e12e-4161-9d01-cac8fe521b02 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.723010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29942cf3-e12e-4161-9d01-cac8fe521b02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.723105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29942cf3-e12e-4161-9d01-cac8fe521b02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.723289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29942cf3-e12e-4161-9d01-cac8fe521b02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.723700] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29942cf3-e12e-4161-9d01-cac8fe521b02',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.876640] env[65161]: INFO networking_nsxv3.common.synchronization [None req-f67c4ad7-e0d3-46b3-8ebf-7454be170d6b None None] Enqueued Resource ID: 18c4d910-d35b-444e-b934-c9018ccea5bb with Priority: HIGHEST for action port [ 761.877997] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c4d910-d35b-444e-b934-c9018ccea5bb with Priority: HIGHEST for action port [ 761.877997] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-18c4d910-d35b-444e-b934-c9018ccea5bb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.877997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18c4d910-d35b-444e-b934-c9018ccea5bb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.877997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18c4d910-d35b-444e-b934-c9018ccea5bb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.879063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18c4d910-d35b-444e-b934-c9018ccea5bb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.879450] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18c4d910-d35b-444e-b934-c9018ccea5bb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.896445] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.225331] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.226545] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.226671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.226803] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29942cf3-e12e-4161-9d01-cac8fe521b02 with status ACTIVE [ 762.227011] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.227106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.227142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.227323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.227409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.227582] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.227678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.227759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.227883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.228806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.229032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.229155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.229229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.229431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.229517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.229623] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29942cf3-e12e-4161-9d01-cac8fe521b02 is going to be updated. [ 762.268248] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.268248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.268248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.268248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.268248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.268248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29942cf3-e12e-4161-9d01-cac8fe521b02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.382362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18c4d910-d35b-444e-b934-c9018ccea5bb [ 762.382578] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.382719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.382792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.383026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.383119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.383220] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18c4d910-d35b-444e-b934-c9018ccea5bb already deleted. [ 762.383297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18c4d910-d35b-444e-b934-c9018ccea5bb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.398473] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.398637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.398710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.398930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.399036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.399136] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 762.432629] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.432757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.432837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.433126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.433272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.444272] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 762.594499] env[65161]: INFO networking_nsxv3.common.synchronization [req-5323a453-7cc5-49cf-b931-2eeed72e4172 req-7e303957-26c4-4789-b0c6-26317e9159e4 tempest-MultipleCreateTestJSON-565628387 tempest-MultipleCreateTestJSON-565628387-project-member] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 762.595065] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 762.595523] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.595523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.732652] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.932469] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.932765] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.932955] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.933288] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.933494] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.933643] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.933755] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.934191] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.934372] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.934577] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.934707] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.934849] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.934964] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.935091] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.935202] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.935324] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.955736] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.955941] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.956129] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.956237] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.956578] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-89b51822-cbe0-401c-bce4-f9c07af4828f taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.956764] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-89b51822-cbe0-401c-bce4-f9c07af4828f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.956891] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-89b51822-cbe0-401c-bce4-f9c07af4828f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.957591] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-89b51822-cbe0-401c-bce4-f9c07af4828f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.957785] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b51822-cbe0-401c-bce4-f9c07af4828f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.234670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.234837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.234910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.235141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.235231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.235319] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be created. [ 763.274460] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.274679] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.274778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.274981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.275170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.284641] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: UNINITIALIZED for 2s [ 763.351120] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 763.351352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.351558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.351839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.352040] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.352160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.352224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.352386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.352466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.352551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.352671] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.399945] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 763.400182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.462058] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.462312] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.462432] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.462718] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.462864] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.463105] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 89b51822-cbe0-401c-bce4-f9c07af4828f not found, creating... [ 763.463632] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.463632] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.463632] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.463823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.463852] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.464322] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.464322] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.464455] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.464752] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.464812] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.464902] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 89b51822-cbe0-401c-bce4-f9c07af4828f is going to be created. [ 763.490683] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.490983] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.491081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.491356] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.492160] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.492160] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-89b51822-cbe0-401c-bce4-f9c07af4828f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.855570] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.020855] env[65161]: INFO networking_nsxv3.common.synchronization [req-b5c9f56d-6bc2-446f-b741-6f9eaf295614 req-bfe6a76d-91a5-4f49-8496-75ef8663da5d tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 764.022121] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 764.022121] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.022121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.022121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.022314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.022380] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.022460] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.022590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.022861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.022861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.023890] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.042238] env[65161]: INFO networking_nsxv3.common.synchronization [req-b5c9f56d-6bc2-446f-b741-6f9eaf295614 req-bfe6a76d-91a5-4f49-8496-75ef8663da5d tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 764.042406] env[65161]: INFO networking_nsxv3.common.synchronization [req-b5c9f56d-6bc2-446f-b741-6f9eaf295614 req-bfe6a76d-91a5-4f49-8496-75ef8663da5d tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 764.042987] env[65161]: INFO networking_nsxv3.common.synchronization [req-b5c9f56d-6bc2-446f-b741-6f9eaf295614 req-bfe6a76d-91a5-4f49-8496-75ef8663da5d tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with Priority: HIGHEST for action port [ 764.043515] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_rules [ 764.043783] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 764.043923] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with Priority: HIGHEST for action port [ 764.044299] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.044839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.045092] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.045435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.045435] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.045541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.045945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.045945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.045945] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ff8b556-8b18-456a-b1a6-f2fecb63b1df',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.235538] env[65161]: INFO networking_nsxv3.common.synchronization [req-5323a453-7cc5-49cf-b931-2eeed72e4172 req-526efd6c-4d84-44b4-a6ad-6f2c2eeeaab0 service nova] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_rules [ 764.235656] env[65161]: INFO networking_nsxv3.common.synchronization [req-5323a453-7cc5-49cf-b931-2eeed72e4172 req-526efd6c-4d84-44b4-a6ad-6f2c2eeeaab0 service nova] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 764.235833] env[65161]: INFO networking_nsxv3.common.synchronization [req-5323a453-7cc5-49cf-b931-2eeed72e4172 req-526efd6c-4d84-44b4-a6ad-6f2c2eeeaab0 service nova] Enqueued Resource ID: 89b51822-cbe0-401c-bce4-f9c07af4828f with Priority: HIGHEST for action port [ 764.236394] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_rules [ 764.236652] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 764.236730] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b51822-cbe0-401c-bce4-f9c07af4828f with Priority: HIGHEST for action port [ 764.237118] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.237183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.237358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.237439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.237673] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-89b51822-cbe0-401c-bce4-f9c07af4828f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.237794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89b51822-cbe0-401c-bce4-f9c07af4828f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.237794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89b51822-cbe0-401c-bce4-f9c07af4828f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.237951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89b51822-cbe0-401c-bce4-f9c07af4828f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.238042] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89b51822-cbe0-401c-bce4-f9c07af4828f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.359941] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5eae70bb-b2d5-4683-837e-e701a57929f1: rpc.has_security_group_logging(os_id): False [ 764.384022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.384022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.384022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.384022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.384022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.384022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.384022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.384022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.384022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.384022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.384022] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be updated. [ 764.457365] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 764.457584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.457762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.457979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.458187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.458312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.458374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.458532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.458637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.458781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.458781] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.462414] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.462414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.462993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.465225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.465225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.489834] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: IN_PROGRESS for 2s [ 764.527108] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.551472] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ff8b556-8b18-456a-b1a6-f2fecb63b1df with status ACTIVE [ 764.551673] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.551820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.551888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.552132] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.552217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.552481] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.552580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.552667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.552841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.552931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.553142] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.553236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.553297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.553447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.553528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.553770] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ff8b556-8b18-456a-b1a6-f2fecb63b1df is going to be updated. [ 764.578182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.578357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.578398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.578609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.578754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.579078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ff8b556-8b18-456a-b1a6-f2fecb63b1df" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.739697] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89b51822-cbe0-401c-bce4-f9c07af4828f with status ACTIVE [ 764.739920] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.740076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.740176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.740383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.740868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.740868] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.740868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.740868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.741078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.741078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.741240] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.741328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.741652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.741652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.741652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.741771] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89b51822-cbe0-401c-bce4-f9c07af4828f is going to be updated. [ 764.769904] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.770098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.770138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.770355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.770540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.770655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89b51822-cbe0-401c-bce4-f9c07af4828f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.966492] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.966845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.966902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.967422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.967744] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.967924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.968023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.968195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.968288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.968380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.968536] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.968621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.968687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.968827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.968968] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.969080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.969141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.969320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.969403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.969449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.969551] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.030663] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.298243] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 765.298525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.298754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.298961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.299297] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.299297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.299520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.299520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.299684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.299788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.299889] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.300942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.300942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.303090] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.303256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.303309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.303434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.303514] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.303610] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.472772] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 490d862d-f7b2-497d-912a-e1801d9b16ad: rpc.has_security_group_logging(os_id): False [ 765.493266] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.496161] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.496161] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.496161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.496645] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.496645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.496645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.496645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.496645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.496645] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 765.536051] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.536051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.536051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.536051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.536051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.536051] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be updated. [ 765.562555] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.562748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.564227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.564227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.564227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.574923] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: IN_PROGRESS for 2s [ 765.576452] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.576452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.576452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.576452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.576726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.595509] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 765.807314] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.807452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.807655] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.310499] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.510953] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 766.511337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.511574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.511902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.512071] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.816324] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.816324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.816324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.816324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.816324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.816324] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 766.848951] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.848951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.848951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.848951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.848951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.860217] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 767.016636] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.016717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.591072] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 767.591072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.591072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.591072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.591493] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.591493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.591493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.591493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.591493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.591703] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.610479] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 767.610479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.094072] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.596840] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.875909] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 768.875909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.875909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.875909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.875909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.875909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.875909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.875909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.875909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.875909] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.103043] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.103043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.103043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.103043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.103043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.103043] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be updated. [ 769.133019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.133019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.133019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.133019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.133019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.142852] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: IN_PROGRESS for 2s [ 769.237303] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 769.237471] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 769.378724] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.737670] env[65161]: INFO networking_nsxv3.common.synchronization [req-cec62377-ce02-4bb1-8b87-6532476b0118 req-e63f9619-eb97-4f3a-aca9-125aafa6a6f3 tempest-AttachInterfacesUnderV243Test-1077697142 tempest-AttachInterfacesUnderV243Test-1077697142-project-member] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 769.739033] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGHEST for action security_group_members [ 769.739033] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.739247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.883272] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.385858] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.386045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.386160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.386466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.386630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.386673] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 770.430292] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.430292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.430292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.430292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.430292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.441537] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 771.154971] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 771.154971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.156060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.156404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.156619] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.157169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.157257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.157482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.157582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.157684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.157800] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.158774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.158994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.159330] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.159437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.161625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.162280] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.162280] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.162524] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.461362] env[65161]: INFO networking_nsxv3.common.synchronization [None req-856e7360-05c5-4b11-a290-b4d88dad7f09 None None] Enqueued Resource ID: 3e6d4f90-1a35-49ed-a22d-0d402acc624e with Priority: HIGHEST for action port [ 771.461362] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e6d4f90-1a35-49ed-a22d-0d402acc624e with Priority: HIGHEST for action port [ 771.461362] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e6d4f90-1a35-49ed-a22d-0d402acc624e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.461362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e6d4f90-1a35-49ed-a22d-0d402acc624e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.461823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e6d4f90-1a35-49ed-a22d-0d402acc624e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.466297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e6d4f90-1a35-49ed-a22d-0d402acc624e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.466297] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6d4f90-1a35-49ed-a22d-0d402acc624e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.665434] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.667198] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.668019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.668192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.670170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.670170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.670170] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.670170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.670170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.670170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.670170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.670170] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be updated. [ 771.701115] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.701378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.701378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.702717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.703113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.714310] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: IN_PROGRESS for 2s [ 771.968157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e6d4f90-1a35-49ed-a22d-0d402acc624e [ 771.968157] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.968157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.971576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.971576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.971576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.971576] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e6d4f90-1a35-49ed-a22d-0d402acc624e already deleted. [ 771.971576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e6d4f90-1a35-49ed-a22d-0d402acc624e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.051562] env[65161]: INFO networking_nsxv3.common.synchronization [req-da83ee12-0527-486f-bdd5-ffb314f3411d req-c3224a40-86f4-462f-950b-80e1338e34b7 tempest-ServersTestBootFromVolume-330207307 tempest-ServersTestBootFromVolume-330207307-project-member] Enqueued Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_members [ 772.052203] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGHEST for action security_group_members [ 772.052515] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cd8909e-2253-4a61-b63b-9d668d108bb9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.052674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.052907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.053057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.053411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.053567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.053607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.053804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.053853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.053943] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.175802] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5eae70bb-b2d5-4683-837e-e701a57929f1: rpc.has_security_group_logging(os_id): False [ 772.194940] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.194940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.194940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.194940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.194940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.194940] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.195436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.195436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.195436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.195436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.195436] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be updated. [ 772.263242] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.263420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.263494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.263711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.263863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.280660] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: IN_PROGRESS for 2s [ 772.452954] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 772.453208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.453376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.453655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.453815] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.453894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.453995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.454151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.454238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.454591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.454591] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.454591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.454591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.454775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.454900] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.454951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.454990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.455132] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.455197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.455272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.455363] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.556254] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.557396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.557396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.557396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.557396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.557396] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.557396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.557396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.557791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.557901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.558238] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 is going to be updated. [ 772.594808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.594953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.596026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.596026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.596026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.606492] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 in Status: IN_PROGRESS for 2s [ 772.958370] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa: rpc.has_security_group_logging(os_id): False [ 772.984091] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.984091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.984091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.984091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.984091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.984091] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.984091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.984091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.984091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.984091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.984091] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.984678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.984678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.984792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.984823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.985195] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.985689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.986116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.986116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.986213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.986332] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be created. [ 773.061765] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.061765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.061765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.061765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.061765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.081674] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 773.730308] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 773.730634] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 deletion is rescheduled due to dependency. [ 773.730675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.788314] env[65161]: INFO networking_nsxv3.common.synchronization [req-0168b775-37c7-484f-b1d1-51277d5df6fc req-57d4110f-63a1-416f-bdcd-5d924056d55b tempest-MigrationsAdminTest-2053071831 tempest-MigrationsAdminTest-2053071831-project-member] Enqueued Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 773.788847] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 773.789301] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.789409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.789491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.789764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.789930] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.790045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.790108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.790309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.790404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.790494] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.293484] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.293646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.293717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.293930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.294145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.294503] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.294503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.294503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.294675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.294751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.294830] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee already deleted. [ 774.294885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.296253] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 in Status: SUCCESS [ 774.296448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.394749] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.394749] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.394749] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.395000] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.395425] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.395660] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.396653] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.396653] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.396653] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.396653] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.396653] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.396841] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.396871] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.397069] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.397594] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.399220] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.420018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.420018] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 774.420018] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.420018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.420018] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.420018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.420018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.420018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.420018] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.496211] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7a728074-2b76-4bfa-8ccb-9e7799aecf4e None None] Enqueued Resource ID: 05a95743-ba51-485a-a2b4-6ff75c7442f5 with Priority: HIGHEST for action port [ 774.496744] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a95743-ba51-485a-a2b4-6ff75c7442f5 with Priority: HIGHEST for action port [ 774.497085] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-05a95743-ba51-485a-a2b4-6ff75c7442f5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.497215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05a95743-ba51-485a-a2b4-6ff75c7442f5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.497274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05a95743-ba51-485a-a2b4-6ff75c7442f5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.497586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05a95743-ba51-485a-a2b4-6ff75c7442f5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.497673] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05a95743-ba51-485a-a2b4-6ff75c7442f5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.617617] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 in Status: SUCCESS [ 774.617617] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 deletion is rescheduled due to dependency. [ 774.617617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.921534] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.922488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.922488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.922488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.922488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.922866] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a not found, creating... [ 774.922981] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.923267] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.923458] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.923777] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.923982] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.924357] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.924581] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.924735] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.925052] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.925245] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.925450] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a is going to be created. [ 774.946810] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.947030] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.947157] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.947420] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.947639] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.947863] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.999598] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05a95743-ba51-485a-a2b4-6ff75c7442f5 [ 774.999898] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.000059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.000153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.000348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.000440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.000529] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05a95743-ba51-485a-a2b4-6ff75c7442f5 already deleted. [ 775.000608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05a95743-ba51-485a-a2b4-6ff75c7442f5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.096563] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 775.096861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.097116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.097393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.097509] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.601241] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.601399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.601478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.601733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.601914] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.602034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.602101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.602263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.602350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.602481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.602544] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.721081] env[65161]: INFO networking_nsxv3.common.synchronization [req-0168b775-37c7-484f-b1d1-51277d5df6fc req-47d5641b-4d1a-489c-a0b7-f8ba3ed63450 service nova] Enqueued Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_rules [ 775.721081] env[65161]: INFO networking_nsxv3.common.synchronization [req-0168b775-37c7-484f-b1d1-51277d5df6fc req-47d5641b-4d1a-489c-a0b7-f8ba3ed63450 service nova] Enqueued Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 775.721081] env[65161]: INFO networking_nsxv3.common.synchronization [req-0168b775-37c7-484f-b1d1-51277d5df6fc req-47d5641b-4d1a-489c-a0b7-f8ba3ed63450 service nova] Enqueued Resource ID: 9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a with Priority: HIGHEST for action port [ 775.721081] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_rules [ 775.721081] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 775.721081] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a with Priority: HIGHEST for action port [ 775.721081] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.721081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.721081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.721081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.721081] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.723053] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.723325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.723498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.723822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.724201] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.724421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.724957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.727018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.727018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.727018] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.730937] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.731240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.732907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.732907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.732907] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.109360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.109360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.109360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.109360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.109360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.110245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.110245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.110245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.110245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.110245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.110245] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.234101] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.235366] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.235587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.235835] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a with status ACTIVE [ 776.236132] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.236289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.236426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.236715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.236901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.237784] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.237784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.237784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.237784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.237784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.238030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.238078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.238985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.238985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.238985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.238985] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a is going to be updated. [ 776.265424] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.265643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.265739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.266353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.266353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.266353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a70058a-6bf1-4c4b-a4a1-7a4fe2bed51a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.612343] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa: rpc.has_security_group_logging(os_id): False [ 776.631186] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.631338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.631408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.631965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.631965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.631965] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.632156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.632156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.632348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.632389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.632654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.632827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.632879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.633020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.633311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.633545] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.635337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.635337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.635337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.635337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.635337] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 776.714324] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.714324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.714324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.714324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.714324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.727409] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 776.740957] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.248038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.248321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.248321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.248539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.248607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.248716] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee is going to be created. [ 777.276466] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.276604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.276672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.276883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.277052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.290112] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: UNINITIALIZED for 2s [ 778.754333] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 778.754333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.298887] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: SUCCESS [ 779.298887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.298887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.298887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.299049] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.299049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.299150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.299343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.299343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.299442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.299521] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.640358] env[65161]: INFO networking_nsxv3.common.synchronization [req-d87b6535-7508-4c08-954a-7d1838e34624 req-5c16fc09-3d98-4f7d-8603-c16ae593e154 tempest-MultipleCreateTestJSON-565628387 tempest-MultipleCreateTestJSON-565628387-project-member] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 779.640939] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 779.641260] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.641398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.641464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.641686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.641891] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.641987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.642063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.642228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.642313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.642411] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.802421] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.802421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.802421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.802421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.802421] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.802421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.802974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.802974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.802974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.802974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.802974] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.803156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.803156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.803919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.803919] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.803919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.803919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.803919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.803919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.803919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.804237] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.144640] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.307158] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9f4e7d3-15ff-431e-9c10-7ea15b2417ee: rpc.has_security_group_logging(os_id): False [ 780.330609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.330861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.330861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.331212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.331330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.332095] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.332248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.332340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.332553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.332753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.333234] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.333234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.333234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.333407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.333490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.333744] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.333912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.333912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.334065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.334142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.334231] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee is going to be created. [ 780.384313] env[65161]: INFO networking_nsxv3.common.synchronization [req-82bee602-e8dd-4624-83a9-e4896b42c114 req-1f57f174-a254-45f4-9b08-d6326896f0ab tempest-MultipleCreateTestJSON-565628387 tempest-MultipleCreateTestJSON-565628387-project-member] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 780.385059] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 780.390174] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.390431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.423797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.423975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.424090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.424328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.424560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.439107] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: IN_PROGRESS for 2s [ 780.646536] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.006853] env[65161]: INFO networking_nsxv3.common.synchronization [None req-6eecab8b-1723-4086-a44e-6799b1d95bda None None] Enqueued Resource ID: 0706de25-d762-4001-906d-9930abc58527 with Priority: HIGHEST for action port [ 781.006853] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0706de25-d762-4001-906d-9930abc58527 with Priority: HIGHEST for action port [ 781.007332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0706de25-d762-4001-906d-9930abc58527 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.007332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0706de25-d762-4001-906d-9930abc58527" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.007332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0706de25-d762-4001-906d-9930abc58527" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.007572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0706de25-d762-4001-906d-9930abc58527" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.007642] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0706de25-d762-4001-906d-9930abc58527',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.152998] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.153342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.153420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.153651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.153766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.153941] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 781.190830] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.191187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.191187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.191920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.191920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.203253] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 781.353713] env[65161]: INFO networking_nsxv3.common.synchronization [None req-2c3d7e62-6176-4bec-af2f-67052013d0c2 None None] Enqueued Resource ID: e57f3e18-2d58-47b3-8150-bd4fa6e24c76 with Priority: HIGHEST for action port [ 781.354434] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e57f3e18-2d58-47b3-8150-bd4fa6e24c76 with Priority: HIGHEST for action port [ 781.354842] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e57f3e18-2d58-47b3-8150-bd4fa6e24c76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.354975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e57f3e18-2d58-47b3-8150-bd4fa6e24c76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.355067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e57f3e18-2d58-47b3-8150-bd4fa6e24c76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.355637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e57f3e18-2d58-47b3-8150-bd4fa6e24c76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.355637] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57f3e18-2d58-47b3-8150-bd4fa6e24c76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.510693] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0706de25-d762-4001-906d-9930abc58527 [ 781.510921] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.511083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.511153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.511376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.511467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.511560] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0706de25-d762-4001-906d-9930abc58527 already deleted. [ 781.511642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0706de25-d762-4001-906d-9930abc58527" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.790586] env[65161]: INFO networking_nsxv3.common.synchronization [req-af8e3fb3-70a1-41dd-9d23-d344d68e82af req-9be5c66f-261b-46d7-b423-7909917e22a6 tempest-ServersAdminNegativeTestJSON-1398107905 tempest-ServersAdminNegativeTestJSON-1398107905-project-member] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 781.791250] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGHEST for action security_group_members [ 781.791577] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.792206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.792206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.792935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.793816] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.793816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.793816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.793816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.793816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.793816] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.860430] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e57f3e18-2d58-47b3-8150-bd4fa6e24c76 [ 781.860834] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.860834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.861267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.861469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.861727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.861844] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e57f3e18-2d58-47b3-8150-bd4fa6e24c76 already deleted. [ 781.861937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e57f3e18-2d58-47b3-8150-bd4fa6e24c76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.299697] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.299697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.299697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.299697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.299697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.300387] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.300387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.300387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.300387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.300387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.300387] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce is going to be updated. [ 782.330978] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.331134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.331203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.331407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.331543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.344032] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: IN_PROGRESS for 2s [ 782.455059] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: SUCCESS [ 782.455059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.171328] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:0 completed [ 783.171564] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:1 started [ 783.212411] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 4s [ 784.288942] env[65161]: INFO networking_nsxv3.common.synchronization [None req-fcc8c899-fd9f-4d59-a513-75765a0a4e52 None None] Enqueued Resource ID: a9844703-688d-4172-b163-4748d1534c8d with Priority: HIGHEST for action port [ 784.289760] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9844703-688d-4172-b163-4748d1534c8d with Priority: HIGHEST for action port [ 784.291086] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9844703-688d-4172-b163-4748d1534c8d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.291086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9844703-688d-4172-b163-4748d1534c8d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.291086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9844703-688d-4172-b163-4748d1534c8d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.291086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9844703-688d-4172-b163-4748d1534c8d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.291086] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9844703-688d-4172-b163-4748d1534c8d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.355581] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45c3c240-33f4-4e4c-b0dc-526406810cce in Status: SUCCESS [ 784.355581] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce deletion is rescheduled due to dependency. [ 784.355581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.671400] env[65161]: INFO networking_nsxv3.common.synchronization [None req-413af0de-5d24-4f9b-b381-f3157936423c tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_rules [ 784.671598] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_rules [ 784.672063] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.672063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.672063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.672328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.672328] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.795095] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9844703-688d-4172-b163-4748d1534c8d [ 784.795518] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.795954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.796049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.796435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.796641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.797335] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9844703-688d-4172-b163-4748d1534c8d already deleted. [ 784.797335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9844703-688d-4172-b163-4748d1534c8d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.816026] env[65161]: INFO networking_nsxv3.common.synchronization [None req-d02be92d-e400-4980-8984-e8a2bc53d4ab None None] Enqueued Resource ID: 9d4781dc-819f-4385-bb60-7ceec31a6ae9 with Priority: HIGHEST for action port [ 784.816026] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d4781dc-819f-4385-bb60-7ceec31a6ae9 with Priority: HIGHEST for action port [ 784.816026] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d4781dc-819f-4385-bb60-7ceec31a6ae9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.816026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d4781dc-819f-4385-bb60-7ceec31a6ae9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.816026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d4781dc-819f-4385-bb60-7ceec31a6ae9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.816413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d4781dc-819f-4385-bb60-7ceec31a6ae9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.816413] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4781dc-819f-4385-bb60-7ceec31a6ae9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.856472] env[65161]: INFO networking_nsxv3.common.synchronization [None req-67b5a272-7319-49d9-8d6b-f73013c523a9 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_rules [ 784.858179] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_rules [ 784.859857] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.859857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.089654] env[65161]: INFO networking_nsxv3.common.synchronization [req-97fa1035-d0dd-4d0c-b94a-98ceda93015e req-605e6d19-2bfb-4451-b04e-a340317cb92f tempest-ServersAdminTestJSON-2133010713 tempest-ServersAdminTestJSON-2133010713-project-member] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 785.090281] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 785.090947] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.090947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.090947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.091139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.091294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.091380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.091439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.091588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.091684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.091912] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.195085] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.195231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.195317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.195506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.195724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.195724] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c already deleted. [ 785.196265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.196265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.196265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.196380] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.252054] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 785.252303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.252480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.252706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.252991] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.253096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.253096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.253266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.254572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.254572] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.324533] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d4781dc-819f-4385-bb60-7ceec31a6ae9 [ 785.324905] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.325063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.325171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.325488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.325624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.325777] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d4781dc-819f-4385-bb60-7ceec31a6ae9 already deleted. [ 785.325913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d4781dc-819f-4385-bb60-7ceec31a6ae9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.594182] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.640197] env[65161]: INFO networking_nsxv3.common.synchronization [req-915ff5ea-411f-41e5-ad0a-7e457bf56563 req-1604d8f1-3067-4814-85da-748da094db1a tempest-AttachVolumeTestJSON-1674268260 tempest-AttachVolumeTestJSON-1674268260-project-member] Enqueued Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_members [ 785.640684] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_members [ 785.640998] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb437f4e-1421-44f7-a301-63abddb16aa0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.641155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.641238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.641832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.641832] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.641832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.641832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.642822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.642822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.642822] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.717054] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.717054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.717054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.717054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.717054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.717054] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c already deleted. [ 785.717054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.759081] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.759081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.759081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.759243] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.759333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.759623] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.759623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.759749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.760971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.760971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.760971] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 785.785919] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.786125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.786161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.786370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.786524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.796872] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 786.096958] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.126754] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.126915] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-254" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.126959] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-254" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.127319] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-254" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.127838] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.127838] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.128031] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.128142] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.128362] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.128494] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.128630] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.128700] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.129392] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.129509] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.129584] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.129889] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.145729] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.145888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.145948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.146172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.146260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.146542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.146542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.146654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.146741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.146817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.146900] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb437f4e-1421-44f7-a301-63abddb16aa0 already deleted. [ 786.146979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.154519] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.154519] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.154519] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.154519] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-254" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.155401] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-59790fd8-79ca-4a64-96e7-d97be1c8ffca taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.155401] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-59790fd8-79ca-4a64-96e7-d97be1c8ffca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.155680] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-59790fd8-79ca-4a64-96e7-d97be1c8ffca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.156841] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-59790fd8-79ca-4a64-96e7-d97be1c8ffca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.156841] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59790fd8-79ca-4a64-96e7-d97be1c8ffca',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.200563] env[65161]: INFO networking_nsxv3.common.synchronization [None req-88bb1372-51a4-4c3f-a73b-94d1e97db54a None None] Enqueued Resource ID: 219abd94-091c-4e3f-882e-41500ad34b7b with Priority: HIGHEST for action port [ 786.200563] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 219abd94-091c-4e3f-882e-41500ad34b7b with Priority: HIGHEST for action port [ 786.200682] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-219abd94-091c-4e3f-882e-41500ad34b7b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.200800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-219abd94-091c-4e3f-882e-41500ad34b7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.200870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-219abd94-091c-4e3f-882e-41500ad34b7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.201151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-219abd94-091c-4e3f-882e-41500ad34b7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.201413] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('219abd94-091c-4e3f-882e-41500ad34b7b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.603817] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.604210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.604210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.604356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.604419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.604520] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 786.635204] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.635380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.635420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.635616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.635759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.646585] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 786.659927] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.660204] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.660300] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.660583] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.660725] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.660877] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 59790fd8-79ca-4a64-96e7-d97be1c8ffca not found, creating... [ 786.661159] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.661545] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.661545] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.661647] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.661793] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.662101] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.662256] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.662367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.662646] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.662706] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.662832] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 59790fd8-79ca-4a64-96e7-d97be1c8ffca is going to be created. [ 786.685499] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.685771] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.685954] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.686261] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.686488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.686702] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-59790fd8-79ca-4a64-96e7-d97be1c8ffca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.704628] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 219abd94-091c-4e3f-882e-41500ad34b7b [ 786.704628] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.704969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.704969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.705048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.705141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.705238] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:219abd94-091c-4e3f-882e-41500ad34b7b already deleted. [ 786.705320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-219abd94-091c-4e3f-882e-41500ad34b7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.449491] env[65161]: INFO networking_nsxv3.common.synchronization [None req-87504b77-1920-4e0c-ac4d-0b72de832b11 None None] Enqueued Resource ID: 8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6 with Priority: HIGHEST for action port [ 787.450410] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6 with Priority: HIGHEST for action port [ 787.450827] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.450884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.451396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.452211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.452308] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.455076] env[65161]: INFO networking_nsxv3.common.synchronization [req-915ff5ea-411f-41e5-ad0a-7e457bf56563 req-5e9cab4a-1ef2-495b-8d36-c6456a95805e service nova] Enqueued Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_rules [ 787.455742] env[65161]: INFO networking_nsxv3.common.synchronization [req-915ff5ea-411f-41e5-ad0a-7e457bf56563 req-5e9cab4a-1ef2-495b-8d36-c6456a95805e service nova] Enqueued Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_members [ 787.455938] env[65161]: INFO networking_nsxv3.common.synchronization [req-915ff5ea-411f-41e5-ad0a-7e457bf56563 req-5e9cab4a-1ef2-495b-8d36-c6456a95805e service nova] Enqueued Resource ID: 59790fd8-79ca-4a64-96e7-d97be1c8ffca with Priority: HIGHEST for action port [ 787.457375] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_rules [ 787.457549] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_members [ 787.457676] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59790fd8-79ca-4a64-96e7-d97be1c8ffca with Priority: HIGHEST for action port [ 787.457979] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb437f4e-1421-44f7-a301-63abddb16aa0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.458153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.458401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.458401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.458560] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.462045] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb437f4e-1421-44f7-a301-63abddb16aa0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.462045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.462045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.462045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.462045] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.462045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.462045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.462045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.462045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.462045] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.463734] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-59790fd8-79ca-4a64-96e7-d97be1c8ffca taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.463734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59790fd8-79ca-4a64-96e7-d97be1c8ffca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.463734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59790fd8-79ca-4a64-96e7-d97be1c8ffca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.463734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59790fd8-79ca-4a64-96e7-d97be1c8ffca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.463734] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59790fd8-79ca-4a64-96e7-d97be1c8ffca',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.606507] env[65161]: INFO networking_nsxv3.common.synchronization [None req-97aaa353-a1e4-4751-ada1-370471249b5b None None] Enqueued Resource ID: 031f2fce-3187-4796-a997-93da92eea78b with Priority: HIGHEST for action port [ 787.606810] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 031f2fce-3187-4796-a997-93da92eea78b with Priority: HIGHEST for action port [ 787.608719] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-031f2fce-3187-4796-a997-93da92eea78b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.608719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-031f2fce-3187-4796-a997-93da92eea78b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.608719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-031f2fce-3187-4796-a997-93da92eea78b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.608719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-031f2fce-3187-4796-a997-93da92eea78b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.608719] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('031f2fce-3187-4796-a997-93da92eea78b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.807983] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 787.807983] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa deletion is rescheduled due to dependency. [ 787.807983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.958061] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6 [ 787.958341] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.958462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.958528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.958984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.958984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.958984] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6 already deleted. [ 787.960125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8adbcff6-21fb-4fe5-bc89-5eaaf657fbd6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.967010] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb437f4e-1421-44f7-a301-63abddb16aa0 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.967010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.967163] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.968998] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59790fd8-79ca-4a64-96e7-d97be1c8ffca with status ACTIVE [ 787.968998] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.968998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.973275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.973275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.973437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.973745] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.975699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.975699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.975699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.975699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.975699] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.975699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.975699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.975699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.975699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.975699] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59790fd8-79ca-4a64-96e7-d97be1c8ffca is going to be updated. [ 788.000116] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.000116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.000116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.000116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.000116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.000116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59790fd8-79ca-4a64-96e7-d97be1c8ffca" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.111140] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 031f2fce-3187-4796-a997-93da92eea78b [ 788.111398] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.111537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.111624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.111890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.112265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.112521] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:031f2fce-3187-4796-a997-93da92eea78b already deleted. [ 788.113288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-031f2fce-3187-4796-a997-93da92eea78b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.282957] env[65161]: INFO networking_nsxv3.common.synchronization [req-a498fc06-13f6-4eff-962f-ff41634d0eec req-320fa7f1-038c-4b67-ae40-3458a054db06 tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 788.284757] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 788.285085] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.285398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.285398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.285558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.285670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.285813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.286025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.286025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.286186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.286186] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.470046] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.657701] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 788.659701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.714756] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.715046] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.715129] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.716074] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.716074] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.716074] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.716074] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.716848] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.717017] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.717228] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.717335] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.717438] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.717539] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.717641] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.717737] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.721112] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.744502] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.744666] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.744778] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.745355] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.745355] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-f8db706e-fb72-4858-882a-728748e816c4 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.745711] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-f8db706e-fb72-4858-882a-728748e816c4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.745711] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-f8db706e-fb72-4858-882a-728748e816c4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.746106] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-f8db706e-fb72-4858-882a-728748e816c4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.746242] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8db706e-fb72-4858-882a-728748e816c4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.789548] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.789548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.789548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.789548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.789548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.790082] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.790169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.790241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.790407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.790493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.790584] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 788.818773] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.818957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.819224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.819489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.819648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.829455] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 788.973663] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.973831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.973931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.974130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.974231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.974341] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb437f4e-1421-44f7-a301-63abddb16aa0 is going to be created. [ 789.002999] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.003277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.003277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.003472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.004051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.017086] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb437f4e-1421-44f7-a301-63abddb16aa0 in Status: UNINITIALIZED for 2s [ 789.248966] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.249401] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.249401] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.249978] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.249978] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.249978] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port f8db706e-fb72-4858-882a-728748e816c4 not found, creating... [ 789.250771] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.250771] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.250771] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.250771] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.250771] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.251076] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.251231] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.251414] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.251531] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.251658] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.251806] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: f8db706e-fb72-4858-882a-728748e816c4 is going to be created. [ 789.282177] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.282505] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.282629] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.283044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.283283] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.283507] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-f8db706e-fb72-4858-882a-728748e816c4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.050628] env[65161]: INFO networking_nsxv3.common.synchronization [req-a498fc06-13f6-4eff-962f-ff41634d0eec req-88682b03-b8b6-4f13-8b57-a8ba9dd225a2 service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 790.050628] env[65161]: INFO networking_nsxv3.common.synchronization [req-a498fc06-13f6-4eff-962f-ff41634d0eec req-88682b03-b8b6-4f13-8b57-a8ba9dd225a2 service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 790.050954] env[65161]: INFO networking_nsxv3.common.synchronization [req-a498fc06-13f6-4eff-962f-ff41634d0eec req-88682b03-b8b6-4f13-8b57-a8ba9dd225a2 service nova] Enqueued Resource ID: f8db706e-fb72-4858-882a-728748e816c4 with Priority: HIGHEST for action port [ 790.051434] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 790.051568] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 790.051694] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8db706e-fb72-4858-882a-728748e816c4 with Priority: HIGHEST for action port [ 790.052204] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.052417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.052494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.052755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.052862] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.054461] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.054596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.054745] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8db706e-fb72-4858-882a-728748e816c4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.054850] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8db706e-fb72-4858-882a-728748e816c4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.056154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8db706e-fb72-4858-882a-728748e816c4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.056154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8db706e-fb72-4858-882a-728748e816c4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.056154] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8db706e-fb72-4858-882a-728748e816c4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.555472] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.555603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.561722] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8db706e-fb72-4858-882a-728748e816c4 with status ACTIVE [ 790.561722] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.561722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.561722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.561995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.562221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.562419] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.562528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.562571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.562731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.562832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.563021] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.563150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.563203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.563335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.563390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.563485] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8db706e-fb72-4858-882a-728748e816c4 is going to be updated. [ 790.583602] env[65161]: INFO networking_nsxv3.common.synchronization [None req-b8302b2b-bdfb-4ddf-83ba-2d61a0a33144 None None] Enqueued Resource ID: dfbe6a63-6baa-481c-ac3a-50cbdd55f09e with Priority: HIGHEST for action port [ 790.583602] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbe6a63-6baa-481c-ac3a-50cbdd55f09e with Priority: HIGHEST for action port [ 790.583806] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfbe6a63-6baa-481c-ac3a-50cbdd55f09e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.583931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfbe6a63-6baa-481c-ac3a-50cbdd55f09e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.583997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfbe6a63-6baa-481c-ac3a-50cbdd55f09e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.584262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfbe6a63-6baa-481c-ac3a-50cbdd55f09e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.584350] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfbe6a63-6baa-481c-ac3a-50cbdd55f09e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.586102] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.586224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.586290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.586825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.587128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.587302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8db706e-fb72-4858-882a-728748e816c4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.850555] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 790.851125] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b deletion is rescheduled due to dependency. [ 790.853030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.853030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.853030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.853030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.853030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.853030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.853030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.853030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.853030] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.028031] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb437f4e-1421-44f7-a301-63abddb16aa0 in Status: SUCCESS [ 791.028031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.028031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.028265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.028454] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.028571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.029122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.029122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.029122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.029122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.029328] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.035191] env[65161]: INFO networking_nsxv3.common.synchronization [req-adcd9ff5-c84f-407b-9292-e6fd15f607ec req-e144963b-c5ec-4e1b-ae81-3dfc20e61437 tempest-ListServerFiltersTestJSON-655968173 tempest-ListServerFiltersTestJSON-655968173-project-member] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 791.036418] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 791.038133] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.038308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.038386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.039084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.039084] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.039203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.039264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.042519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.042519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.042519] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.090739] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfbe6a63-6baa-481c-ac3a-50cbdd55f09e [ 791.091036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.091135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.091183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.091398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.091487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.091923] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfbe6a63-6baa-481c-ac3a-50cbdd55f09e already deleted. [ 791.091923] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfbe6a63-6baa-481c-ac3a-50cbdd55f09e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.356429] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.485783] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.485986] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.486117] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.486447] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.486720] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.486889] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.487823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.487823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.487823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.487823] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.487823] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.487823] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.488179] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.488179] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.488337] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.488337] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.508393] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.508580] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 791.508938] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.508938] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.509360] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-bf1980d7-504c-4c2e-8172-556cff0073b0 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.509505] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-bf1980d7-504c-4c2e-8172-556cff0073b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.509577] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-bf1980d7-504c-4c2e-8172-556cff0073b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.509860] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-bf1980d7-504c-4c2e-8172-556cff0073b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.509990] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1980d7-504c-4c2e-8172-556cff0073b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.534025] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.544015] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.544348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.544538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.544831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.545014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.545288] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.545518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.545666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.545921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.546118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.546380] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 already deleted. [ 791.546584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.860375] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.012661] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.012952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.013096] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.013867] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.014065] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.014389] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port bf1980d7-504c-4c2e-8172-556cff0073b0 not found, creating... [ 792.015206] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.015206] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.015206] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.015206] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.015462] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.016228] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.016228] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.016484] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.016777] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.016777] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.017305] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: bf1980d7-504c-4c2e-8172-556cff0073b0 is going to be created. [ 792.034150] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb437f4e-1421-44f7-a301-63abddb16aa0: rpc.has_security_group_logging(os_id): False [ 792.052672] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.052978] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.053156] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.053718] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.054042] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.054339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-bf1980d7-504c-4c2e-8172-556cff0073b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.056309] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.056449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.056534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.056771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.056903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.057233] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.057401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.057469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.057694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.057851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.057994] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb437f4e-1421-44f7-a301-63abddb16aa0 is going to be created. [ 792.140828] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.141194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.141194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.141285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.141444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.163812] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb437f4e-1421-44f7-a301-63abddb16aa0 in Status: IN_PROGRESS for 2s [ 792.368023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.368023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.368023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.368023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.368023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.368023] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 792.402760] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.403048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.403124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.403297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.403447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.412899] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 792.799455] env[65161]: INFO networking_nsxv3.common.synchronization [req-adcd9ff5-c84f-407b-9292-e6fd15f607ec req-b5fe07ce-b748-4ee7-a7e5-fc8bc3888c9f service nova] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_rules [ 792.799568] env[65161]: INFO networking_nsxv3.common.synchronization [req-adcd9ff5-c84f-407b-9292-e6fd15f607ec req-b5fe07ce-b748-4ee7-a7e5-fc8bc3888c9f service nova] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 792.799706] env[65161]: INFO networking_nsxv3.common.synchronization [req-adcd9ff5-c84f-407b-9292-e6fd15f607ec req-b5fe07ce-b748-4ee7-a7e5-fc8bc3888c9f service nova] Enqueued Resource ID: bf1980d7-504c-4c2e-8172-556cff0073b0 with Priority: HIGHEST for action port [ 792.800305] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_rules [ 792.800459] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 792.800558] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf1980d7-504c-4c2e-8172-556cff0073b0 with Priority: HIGHEST for action port [ 792.801581] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.801714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.801843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.802155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.802284] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.803690] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.803690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.803690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.803690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.803690] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.803992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.803992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.803992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.804148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.804191] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.805304] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf1980d7-504c-4c2e-8172-556cff0073b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.805304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf1980d7-504c-4c2e-8172-556cff0073b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.805304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf1980d7-504c-4c2e-8172-556cff0073b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.805516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf1980d7-504c-4c2e-8172-556cff0073b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.805516] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf1980d7-504c-4c2e-8172-556cff0073b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.088071] env[65161]: INFO networking_nsxv3.common.synchronization [None req-f2de4653-3c75-4623-881e-9f85c2d87be5 tempest-ServersWithSpecificFlavorTestJSON-1681046468 tempest-ServersWithSpecificFlavorTestJSON-1681046468-project-member] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_rules [ 793.089261] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_rules [ 793.089516] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.089666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.089740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.090136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.090285] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.203066] env[65161]: INFO networking_nsxv3.common.synchronization [None req-60684ae6-31b3-4c13-aa59-37c7b56e5253 tempest-ServersWithSpecificFlavorTestJSON-1681046468 tempest-ServersWithSpecificFlavorTestJSON-1681046468-project-member] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_rules [ 793.203714] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_rules [ 793.204046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.204213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.206841] env[65161]: INFO networking_nsxv3.common.synchronization [req-8bf48ce1-5178-4591-acf9-02ead3c339ff req-40225cc4-c10e-44ca-b543-660e494a9e00 tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 793.207075] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 793.207627] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.207794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.207794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.208194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.208194] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.208344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.208344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.208463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.208589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.208630] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.307150] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.308397] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.308397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.311256] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf1980d7-504c-4c2e-8172-556cff0073b0 with status ACTIVE [ 793.311488] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.315076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.315252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.315600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.315600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.315818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.315939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.316009] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.316162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.316621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.316621] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.316621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.316621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.316807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.316807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.316865] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf1980d7-504c-4c2e-8172-556cff0073b0 is going to be updated. [ 793.342899] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.343064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.343142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.343352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.343692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.343692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf1980d7-504c-4c2e-8172-556cff0073b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.610566] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.610717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.610790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.611025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.611122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.611220] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 already deleted. [ 793.611304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.611452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.611613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.611698] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.711077] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.711246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.711329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.711716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.711716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.712521] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.712695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.712804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.713007] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.714751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.714751] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 793.744828] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.744828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.745382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.745382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.745382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.756599] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 793.809880] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.137368] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.137552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.137591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.137792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.137913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.138021] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 already deleted. [ 794.138119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.175252] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb437f4e-1421-44f7-a301-63abddb16aa0 in Status: SUCCESS [ 794.175557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.312406] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.312678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.312678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.312856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.312909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.312985] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be created. [ 794.340159] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.340301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.340358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.340571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.340730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.354351] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: UNINITIALIZED for 2s [ 794.422399] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 794.422632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.423122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.423122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.423212] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.423321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.423435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.423518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.423608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.423694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.423786] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.925676] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.925959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.926144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.926472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.926757] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.926907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.926969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.927210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.927366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.927422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.927696] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.927798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.927859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.928063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.928279] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.928508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.928597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.928731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.928815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.928903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.929007] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.433051] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68ff1a7f-59cd-4081-9af0-9322734ba92b: rpc.has_security_group_logging(os_id): False [ 795.471941] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.472218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.472287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.472967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.472967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.473243] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.473377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.473449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.473659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.473776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.474248] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.474433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.474891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.474891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.475064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.475384] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.475473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.475559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.475779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.475908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.476530] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 795.564396] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.564570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.564646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.564825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.564983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.584185] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 795.766811] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 795.767141] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 795.767232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.803633] env[65161]: INFO networking_nsxv3.common.synchronization [req-45ca11cd-ae2e-4193-aa44-b9b30a9477c4 req-764138a1-8cb1-4258-8a1e-2bce154d00de tempest-ServerActionsV293TestJSON-816812624 tempest-ServerActionsV293TestJSON-816812624-project-member] Enqueued Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_members [ 795.804389] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGHEST for action security_group_members [ 795.804636] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e16b48c-6389-4032-9e70-091f52c4106a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.804960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.805179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.805395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.805557] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.805660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.805720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.805867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.806017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.806069] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.308681] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.309426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.309643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.310165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.310396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.310768] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.311077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.312013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.312013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.312013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.312013] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e16b48c-6389-4032-9e70-091f52c4106a is going to be updated. [ 796.343913] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.344407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.344407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.344510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.344598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.358086] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e16b48c-6389-4032-9e70-091f52c4106a in Status: IN_PROGRESS for 2s [ 796.362072] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 796.362347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.362550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.362832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.363072] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.363265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.363313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.363591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.363713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.363936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.364080] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.866827] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.867097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.867097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.867302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.867512] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.867583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.867646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.867825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.867917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.868024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.868788] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.868788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.868788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.868788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.868788] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.868788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.869121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.869121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.869121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.869202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.869270] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.320691] env[65161]: INFO networking_nsxv3.common.synchronization [None req-a67cda16-374a-46d0-beb7-26cb4c2be289 None None] Enqueued Resource ID: c563d7a0-802f-47bf-bb2c-ec3f7de773c8 with Priority: HIGHEST for action port [ 797.321235] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c563d7a0-802f-47bf-bb2c-ec3f7de773c8 with Priority: HIGHEST for action port [ 797.321532] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-c563d7a0-802f-47bf-bb2c-ec3f7de773c8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.321642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c563d7a0-802f-47bf-bb2c-ec3f7de773c8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.321721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c563d7a0-802f-47bf-bb2c-ec3f7de773c8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.322048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c563d7a0-802f-47bf-bb2c-ec3f7de773c8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.322131] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c563d7a0-802f-47bf-bb2c-ec3f7de773c8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.373421] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6704a80-3529-40ab-83a5-1a8a6167b498: rpc.has_security_group_logging(os_id): False [ 797.393215] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.393412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.393504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.393788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.393915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.395403] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.395403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.395403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.395403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.395403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.395646] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.395646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.395646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.395773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.395924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.396031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.396121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.396169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.396335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.396476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.396476] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be created. [ 797.459370] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.459542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.459542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.460143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.460143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.471930] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 797.614127] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 797.614870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.825651] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c563d7a0-802f-47bf-bb2c-ec3f7de773c8 [ 797.825651] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.825651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.825651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.825651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.825651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.825651] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c563d7a0-802f-47bf-bb2c-ec3f7de773c8 already deleted. [ 797.825651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c563d7a0-802f-47bf-bb2c-ec3f7de773c8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.369564] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e16b48c-6389-4032-9e70-091f52c4106a in Status: SUCCESS [ 798.369987] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e16b48c-6389-4032-9e70-091f52c4106a deletion is rescheduled due to dependency. [ 798.369987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.539168] env[65161]: INFO networking_nsxv3.common.synchronization [req-e60c055f-f77c-4471-a161-fe6719149a89 req-719d2f6d-64d5-4488-b291-b44932377dd8 tempest-ListServerFiltersTestJSON-655968173 tempest-ListServerFiltersTestJSON-655968173-project-member] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 798.545837] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 798.548304] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.548304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.548304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.548304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.548304] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.548304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.548304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.548304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.548304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.548304] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.940095] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.940095] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.940095] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.940095] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.940356] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.940713] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.941059] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.941431] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.941627] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.942328] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.942328] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.942463] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.942853] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.942853] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.942853] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.943024] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.966145] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.966145] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 798.966338] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.966474] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.966813] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.967033] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.967189] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.967955] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.967955] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47e437b-6a5c-4e1e-8a20-75ab34a9f215',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.049567] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.470687] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.471090] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.473222] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.473574] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.473738] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.473896] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port e47e437b-6a5c-4e1e-8a20-75ab34a9f215 not found, creating... [ 799.474284] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.474522] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.474630] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.474799] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.478081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.478081] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.478081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.478081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.478081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.478081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.478081] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: e47e437b-6a5c-4e1e-8a20-75ab34a9f215 is going to be created. [ 799.497912] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 799.498198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.505690] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.506039] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.506223] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.506543] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.506771] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.506996] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.553685] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.928304] env[65161]: INFO networking_nsxv3.common.synchronization [None req-e6d4881f-5db5-46da-870f-f235cb33f5c2 None None] Enqueued Resource ID: e537adb5-66ae-488f-a9dd-1414c153cc72 with Priority: HIGHEST for action port [ 799.928699] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e537adb5-66ae-488f-a9dd-1414c153cc72 with Priority: HIGHEST for action port [ 799.929149] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e537adb5-66ae-488f-a9dd-1414c153cc72 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.929339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e537adb5-66ae-488f-a9dd-1414c153cc72" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.929452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e537adb5-66ae-488f-a9dd-1414c153cc72" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.929833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e537adb5-66ae-488f-a9dd-1414c153cc72" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.929943] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e537adb5-66ae-488f-a9dd-1414c153cc72',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.057470] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.057702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.058547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.058547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.058547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.058547] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 800.095336] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.095336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.095466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.096060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.096060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.109238] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 800.312064] env[65161]: INFO networking_nsxv3.common.synchronization [req-e60c055f-f77c-4471-a161-fe6719149a89 req-c56cd682-4d45-49a2-9f22-2859a6edc580 service nova] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_rules [ 800.313445] env[65161]: INFO networking_nsxv3.common.synchronization [req-e60c055f-f77c-4471-a161-fe6719149a89 req-c56cd682-4d45-49a2-9f22-2859a6edc580 service nova] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 800.313445] env[65161]: INFO networking_nsxv3.common.synchronization [req-e60c055f-f77c-4471-a161-fe6719149a89 req-c56cd682-4d45-49a2-9f22-2859a6edc580 service nova] Enqueued Resource ID: e47e437b-6a5c-4e1e-8a20-75ab34a9f215 with Priority: HIGHEST for action port [ 800.313445] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_rules [ 800.313749] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 800.313749] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e47e437b-6a5c-4e1e-8a20-75ab34a9f215 with Priority: HIGHEST for action port [ 800.316021] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.316021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.316021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.316021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.316021] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.316420] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.316420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.317461] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.317461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.317461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.317461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.317461] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e47e437b-6a5c-4e1e-8a20-75ab34a9f215',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.433459] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e537adb5-66ae-488f-a9dd-1414c153cc72 [ 800.433695] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.433833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.433907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.434170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.434256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.434358] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e537adb5-66ae-488f-a9dd-1414c153cc72 already deleted. [ 800.434433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e537adb5-66ae-488f-a9dd-1414c153cc72" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.821724] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e47e437b-6a5c-4e1e-8a20-75ab34a9f215 with status ACTIVE [ 800.823848] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.823848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.824024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.824509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.824509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.825820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.825820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.825820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.825820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.825820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.825820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.825820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.825820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.825820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.826218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.826218] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e47e437b-6a5c-4e1e-8a20-75ab34a9f215 is going to be updated. [ 800.827238] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.827321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.849020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.849181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.849247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.849467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.849607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.849777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e47e437b-6a5c-4e1e-8a20-75ab34a9f215" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.185961] env[65161]: INFO networking_nsxv3.common.synchronization [req-14632a91-b611-4cab-a754-65f2dc065d87 req-f3864a1d-c936-4430-8a98-4723ed6064c2 tempest-ListServerFiltersTestJSON-655968173 tempest-ListServerFiltersTestJSON-655968173-project-member] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 801.186638] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 801.187242] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.187242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.528897] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.528897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.528897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.528897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.528897] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.528897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.528897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.528897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.528897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.528897] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.528897] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.528897] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.528897] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.529344] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 801.529344] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.529344] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.550470] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.550470] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 801.550470] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.550743] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-622" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.550882] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-34b65435-ada5-42aa-8446-f607e98add4d taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.551347] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-34b65435-ada5-42aa-8446-f607e98add4d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.551347] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-34b65435-ada5-42aa-8446-f607e98add4d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.551527] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-34b65435-ada5-42aa-8446-f607e98add4d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.551671] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34b65435-ada5-42aa-8446-f607e98add4d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.054799] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.054799] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.054799] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.055208] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.055309] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.055408] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 34b65435-ada5-42aa-8446-f607e98add4d not found, creating... [ 802.055662] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.055831] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.055914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.056145] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.056279] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.057044] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.057044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.057044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.057044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.058154] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.058431] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 34b65435-ada5-42aa-8446-f607e98add4d is going to be created. [ 802.078617] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.078875] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.078989] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.079263] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.079483] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.079687] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-34b65435-ada5-42aa-8446-f607e98add4d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.120210] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 802.120572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.120759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.120975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.121439] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.121439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.121439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.121602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.121667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.121756] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.624076] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.822438] env[65161]: INFO networking_nsxv3.common.synchronization [req-14632a91-b611-4cab-a754-65f2dc065d87 req-5841d1af-66c5-4d87-9690-b38306550535 service nova] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_rules [ 802.822678] env[65161]: INFO networking_nsxv3.common.synchronization [req-14632a91-b611-4cab-a754-65f2dc065d87 req-5841d1af-66c5-4d87-9690-b38306550535 service nova] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 802.822766] env[65161]: INFO networking_nsxv3.common.synchronization [req-14632a91-b611-4cab-a754-65f2dc065d87 req-5841d1af-66c5-4d87-9690-b38306550535 service nova] Enqueued Resource ID: 34b65435-ada5-42aa-8446-f607e98add4d with Priority: HIGHEST for action port [ 802.823321] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_rules [ 802.823586] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 802.823586] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b65435-ada5-42aa-8446-f607e98add4d with Priority: HIGHEST for action port [ 802.824311] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.824405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.824630] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.824687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.824852] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-34b65435-ada5-42aa-8446-f607e98add4d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.824958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34b65435-ada5-42aa-8446-f607e98add4d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.825032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34b65435-ada5-42aa-8446-f607e98add4d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.825235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34b65435-ada5-42aa-8446-f607e98add4d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.825316] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34b65435-ada5-42aa-8446-f607e98add4d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.130231] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.329704] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34b65435-ada5-42aa-8446-f607e98add4d with status ACTIVE [ 803.329793] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.329901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.329941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.330480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.330480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.330591] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.330694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.330771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.331181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.331181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.331181] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.331324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.331324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.331463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.331499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.331694] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34b65435-ada5-42aa-8446-f607e98add4d is going to be updated. [ 803.354008] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.354112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.354173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.354383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.355824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.355824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34b65435-ada5-42aa-8446-f607e98add4d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.633200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.633200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.633200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.633754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.633754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.633754] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 803.663092] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.663250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.663319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.663526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.663680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.673849] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 803.939085] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fe6f1a6-97df-49d8-8b69-5553a49a00fd req-03d14cfc-86a5-4cad-957f-2c686412a9c2 tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 803.939668] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 803.939980] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.940694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.940799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.941110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.941864] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.941999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.942097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.942357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.942828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.943051] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.357219] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.357219] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.357219] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.357219] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.357701] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.357772] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.357918] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.358193] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.358320] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.358458] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.358585] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.358704] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.358803] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.358912] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.359066] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.360139] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.380320] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.380449] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.380599] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.380735] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.381153] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.381442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.381442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.381706] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.381838] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.438379] env[65161]: INFO networking_nsxv3.common.synchronization [req-56812af7-d18b-4201-915e-8844dfe8d6e3 req-b4a7826d-4301-4c2b-89a4-404d4111da0c tempest-ServersTestManualDisk-1978629773 tempest-ServersTestManualDisk-1978629773-project-member] Enqueued Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_members [ 804.438998] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGHEST for action security_group_members [ 804.439333] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc716056-e80f-437c-a978-42b0cd24b9c7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.439460] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.439550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.439917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.440146] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.440260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.440333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.440520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.440614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.440711] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.445348] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.445521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.445625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.445894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.446045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.446549] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.446695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.446769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.446923] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.447014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.447110] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 already deleted. [ 804.447192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.886682] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.886909] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.888099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.888099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.888099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.888099] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e not found, creating... [ 804.888099] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.888099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.888099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.888522] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.888522] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.889495] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.889495] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.889495] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.889495] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.889495] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.889495] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e is going to be created. [ 804.912586] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.913559] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.913559] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.913559] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.913751] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.914576] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.943165] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.943353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.943524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.943656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.943750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.943969] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.944075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.944141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.944324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.944401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.944488] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc716056-e80f-437c-a978-42b0cd24b9c7 is going to be updated. [ 804.985272] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.985466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.985528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.985697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.986186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.998331] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc716056-e80f-437c-a978-42b0cd24b9c7 in Status: IN_PROGRESS for 2s [ 805.656068] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fe6f1a6-97df-49d8-8b69-5553a49a00fd req-06e87cf5-c9f8-48e6-864c-5d983f6bfd07 service nova] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_rules [ 805.656323] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fe6f1a6-97df-49d8-8b69-5553a49a00fd req-06e87cf5-c9f8-48e6-864c-5d983f6bfd07 service nova] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 805.656363] env[65161]: INFO networking_nsxv3.common.synchronization [req-0fe6f1a6-97df-49d8-8b69-5553a49a00fd req-06e87cf5-c9f8-48e6-864c-5d983f6bfd07 service nova] Enqueued Resource ID: ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e with Priority: HIGHEST for action port [ 805.656587] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_rules [ 805.656712] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 805.656806] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e with Priority: HIGHEST for action port [ 805.660120] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.660120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.660120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.660120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.660120] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.660600] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.660600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.660746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.660817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.660966] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.661073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.661131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.661268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.661365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.661476] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.662298] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.662398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.662455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.662610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.662679] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.687230] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 805.687230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.687230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.687230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.687230] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.687230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.687230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.687635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.687635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.687635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.687635] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.688400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.688561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.688764] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.689024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.689024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.689165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.689165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.689246] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.165284] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.165425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.165615] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.166581] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e with status ACTIVE [ 806.166770] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.166888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.166962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.167301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.167389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.167564] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.170699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.170834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.171143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.171307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.171467] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.171605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.171655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.171821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.171912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.171975] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e is going to be updated. [ 806.191382] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.191547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.191707] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.197656] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.197656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.197656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.197860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.198212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.198212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba0e4123-cb1e-41c8-97ca-ac5ff4b4be3e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.673803] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.694826] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.009762] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc716056-e80f-437c-a978-42b0cd24b9c7 in Status: SUCCESS [ 807.009762] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc716056-e80f-437c-a978-42b0cd24b9c7 deletion is rescheduled due to dependency. [ 807.009886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.176555] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.176717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.176796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.177017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.177105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.177198] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be created. [ 807.201258] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.201509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.201509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.201716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.201822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.201971] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 807.221492] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.221695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.221743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.222035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.222209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.233136] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: UNINITIALIZED for 2s [ 807.250385] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.250529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.250602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.250814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.251542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.268732] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 808.127327] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.127327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.127327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.127665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.127665] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.630915] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.132706] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.243853] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 809.244165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.245035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.245035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.245035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.245035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.245035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.245286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.245286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.245396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.245512] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.252781] env[65161]: INFO networking_nsxv3.common.synchronization [req-32d020d6-8dae-481f-935b-6151f2fc2a98 req-c76b8cea-9836-42e0-a6e3-d14589da4f97 tempest-FloatingIPsAssociationTestJSON-2068989689 tempest-FloatingIPsAssociationTestJSON-2068989689-project-member] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 809.253410] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGHEST for action security_group_members [ 809.254193] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.254193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.254193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.254193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.254965] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.254965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.254965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.254965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.254965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.254965] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.278873] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 809.279194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.279760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.280037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.280247] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.280363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.280502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.280649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.280702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.281488] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.639398] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 809.639398] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 809.749268] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.757627] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.757721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.757814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.758233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.758350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.758622] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.758782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.758782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.759724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.759724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.759724] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 is going to be updated. [ 809.783963] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.802492] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.802492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.802492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.804687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.804687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.815251] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: IN_PROGRESS for 2s [ 810.252128] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d21165f7-b2bc-43ce-8cb7-61f74b45df43: rpc.has_security_group_logging(os_id): False [ 810.282976] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.283299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.283390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.283617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.283749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.284947] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.284947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.284947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.284947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.284947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.284947] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be created. [ 810.288673] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.408772] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.409024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.409129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.409413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.409667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.428430] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: IN_PROGRESS for 2s [ 810.698525] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.698667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.698736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.698976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.713662] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 810.714563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.715595] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 810.747869] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.747977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.747977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.748223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.754616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.755168] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 810.755242] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 810.755342] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 810.788767] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.788949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.788990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.789266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.789363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.789463] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 810.796087] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.796274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.796346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.796632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.798141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.798360] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 810.821375] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.821563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.821633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.821847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.822031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.831080] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 810.868514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.868714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.868785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.869071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.869381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.869670] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 810.936273] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.936431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.937864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.937864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.937864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.937864] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 810.937864] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8e16b48c-6389-4032-9e70-091f52c4106a', '9daee2fc-9524-40ce-9dad-b50ca4273bc4', 'fd743095-5c04-42e0-a757-109988198d4e', 'b51ab0e8-12bd-4de0-9195-4b7a1c129654', 'aeec6a6a-0263-4e7c-aea8-f50dc769d7fd', '0ad6db30-29dc-46c6-907d-4e2e1d7dd18d', 'd21165f7-b2bc-43ce-8cb7-61f74b45df43', '22b5f607-a69e-46b7-93e8-49d4437a6864', 'b7980d5f-c7aa-4292-9189-bc351c994c0f', 'ba07905f-c3ad-48a2-95c0-86b2e0e304c6', '37b81f40-c340-4f5d-8250-ce4f8efa78fe', '200ba9e0-f56c-4b5d-9e39-69a507140fda', '0e081805-9c1f-4f53-b736-a7dddaec90b6', '9cd8909e-2253-4a61-b63b-9d668d108bb9', '06af9b92-f2b2-48b1-bf38-8ca0713490e4', '3151ee71-d6fa-4cda-bd22-0038b5e588ee', '4f835b02-6879-4c48-95a4-22113f8049b5', 'c1dbf9f4-1099-4ece-bc31-dfb21c800cbf', '68ff1a7f-59cd-4081-9af0-9322734ba92b', '86add6f1-e722-4f5b-89cc-222fed23d419', '5eae70bb-b2d5-4683-837e-e701a57929f1', 'dad00945-a380-4452-8a37-64cfdbf9d432', '490d862d-f7b2-497d-912a-e1801d9b16ad', '1d23f6bd-c3d6-4abc-b853-77560027d5d9', '48e5829e-83e0-44d7-b9e9-c3210ec30d0d', 'cb265379-c4fb-47cf-afb5-2c655df91dbf', 'cc716056-e80f-437c-a978-42b0cd24b9c7', '1b4da512-0ef0-4e5a-aad1-7eff0f72d14f', 'e24f796e-b77b-42f0-a7c2-ae92228b28c5', '45c3c240-33f4-4e4c-b0dc-526406810cce', 'aa3f13db-d36f-47b7-bca4-30b32f714725', 'b59bd654-2015-4855-bb01-60ad0a84a0b0', 'bb437f4e-1421-44f7-a301-63abddb16aa0', '494ab5ab-6967-4eb3-bee6-73cd0bcd16fa', 'c9f4e7d3-15ff-431e-9c10-7ea15b2417ee', 'e6704a80-3529-40ab-83a5-1a8a6167b498'} {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 810.937864] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 810.962430] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.962637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.962785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.963105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.963248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.963367] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 810.963576] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 810.963576] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 811.038405] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.038664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.038664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.038848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.039654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.039922] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 811.040027] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 811.040089] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 811.040173] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 811.040254] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 811.040326] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGH for action security_group_rules [ 811.040404] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGH for action security_group_rules [ 811.040469] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGH for action security_group_rules [ 811.040532] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGH for action security_group_rules [ 811.040593] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGH for action security_group_rules [ 811.040651] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGH for action security_group_rules [ 811.040705] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGH for action security_group_rules [ 811.040769] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGH for action security_group_rules [ 811.040844] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGH for action security_group_rules [ 811.040910] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGH for action security_group_rules [ 811.040975] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGH for action security_group_rules [ 811.041053] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGH for action security_group_rules [ 811.041136] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGH for action security_group_rules [ 811.041189] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGH for action security_group_rules [ 811.041232] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGH for action security_group_rules [ 811.041274] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGH for action security_group_rules [ 811.041480] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGH for action security_group_rules [ 811.041582] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGH for action security_group_rules [ 811.041661] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGH for action security_group_rules [ 811.041698] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGH for action security_group_rules [ 811.041791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.827936] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3f13db-d36f-47b7-bca4-30b32f714725 in Status: SUCCESS [ 811.828250] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 deletion is rescheduled due to dependency. [ 811.828250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.328635] env[65161]: INFO networking_nsxv3.common.synchronization [req-34713332-c03e-4bf3-9078-d47beacd0a8d req-21e496cf-5366-4762-a961-557549f492af tempest-ServerAddressesTestJSON-1411495363 tempest-ServerAddressesTestJSON-1411495363-project-member] Enqueued Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGHEST for action security_group_members [ 812.331325] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGHEST for action security_group_members [ 812.331325] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e16b48c-6389-4032-9e70-091f52c4106a with Priority: HIGH for action security_group_rules [ 812.331325] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd743095-5c04-42e0-a757-109988198d4e with Priority: HIGH for action security_group_rules [ 812.331325] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGH for action security_group_rules [ 812.331325] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGH for action security_group_rules [ 812.331325] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86add6f1-e722-4f5b-89cc-222fed23d419 with Priority: HIGH for action security_group_rules [ 812.331574] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGH for action security_group_rules [ 812.331574] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf with Priority: HIGH for action security_group_rules [ 812.331633] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f835b02-6879-4c48-95a4-22113f8049b5 with Priority: HIGH for action security_group_rules [ 812.331733] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 with Priority: HIGH for action security_group_rules [ 812.331824] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee with Priority: HIGH for action security_group_rules [ 812.331994] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 with Priority: HIGH for action security_group_rules [ 812.332193] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGH for action security_group_rules [ 812.332324] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGH for action security_group_rules [ 812.332423] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 with Priority: HIGH for action security_group_rules [ 812.332514] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7980d5f-c7aa-4292-9189-bc351c994c0f with Priority: HIGH for action security_group_rules [ 812.332610] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d with Priority: HIGH for action security_group_rules [ 812.332698] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGH for action security_group_rules [ 812.332785] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGH for action security_group_rules [ 812.332877] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 with Priority: HIGH for action security_group_rules [ 812.332964] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGH for action security_group_rules [ 812.334346] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-403126a0-3b4c-4623-8ce4-c311b9739fcb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.334493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.334562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.334826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.334993] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.335170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.335170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.335379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.335625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.335625] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.340560] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e16b48c-6389-4032-9e70-091f52c4106a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.340733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.340804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.341026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.341164] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e16b48c-6389-4032-9e70-091f52c4106a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.342726] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd743095-5c04-42e0-a757-109988198d4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.342726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.342726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.343066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.344577] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd743095-5c04-42e0-a757-109988198d4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.346274] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.346274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.346274] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.346274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.346274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.346274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.346274] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.348137] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86add6f1-e722-4f5b-89cc-222fed23d419 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.348137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.348137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.348137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.348137] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86add6f1-e722-4f5b-89cc-222fed23d419',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.349777] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.351275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.351275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.351275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.351275] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.351579] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.351700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.351758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.351954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.351954] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1dbf9f4-1099-4ece-bc31-dfb21c800cbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.353593] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f835b02-6879-4c48-95a4-22113f8049b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.353776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.353776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.353954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.354042] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f835b02-6879-4c48-95a4-22113f8049b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.355353] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cd8909e-2253-4a61-b63b-9d668d108bb9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.355488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.356079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.356079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.356079] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cd8909e-2253-4a61-b63b-9d668d108bb9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.357523] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.360748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.360748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.360748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.360748] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3151ee71-d6fa-4cda-bd22-0038b5e588ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.360748] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e081805-9c1f-4f53-b736-a7dddaec90b6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.360748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.360748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.360748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.360748] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e081805-9c1f-4f53-b736-a7dddaec90b6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.360748] env[65161]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 812.361269] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.361269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.361269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.361398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.361432] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.362901] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.363103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.363103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.363231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.363300] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.364212] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.364342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.364385] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.364515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.364582] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba07905f-c3ad-48a2-95c0-86b2e0e304c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.365954] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7980d5f-c7aa-4292-9189-bc351c994c0f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.366099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.366165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.366319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.366391] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7980d5f-c7aa-4292-9189-bc351c994c0f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.367573] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.367573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.367666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.368450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.368450] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ad6db30-29dc-46c6-907d-4e2e1d7dd18d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.368910] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.368910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.368910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.369098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.369098] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.370169] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.370277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.370277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.372298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.372298] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.372298] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.372298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.372298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.372298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.372298] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9daee2fc-9524-40ce-9dad-b50ca4273bc4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.372908] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.372908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.372908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.374902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.374902] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.558256] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.562236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.562364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.562676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.584146] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 812.584380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.584968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.585686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.585686] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.596277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.596398] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e16b48c-6389-4032-9e70-091f52c4106a is going to be deleted. [ 812.660407] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.660596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.660644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.660871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.661052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.661470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e16b48c-6389-4032-9e70-091f52c4106a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.663101] env[65161]: INFO networking_nsxv3.common.synchronization [req-17b79f1d-37e5-49c3-b0e6-9a8f47c5e1b7 req-7e7fa52b-fcd2-4ff0-a931-f468de43fb75 tempest-ListServersNegativeTestJSON-1190994513 tempest-ListServersNegativeTestJSON-1190994513-project-member] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 812.663620] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 812.663915] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.664088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.664175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.664363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.664519] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.664620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.664674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.665047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.665047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.665047] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.665328] env[65161]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 812.731222] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-784 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.731410] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-784" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.731453] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-784" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.731787] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-784" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.732140] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.732339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.733067] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.733067] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.733067] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.733067] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.733295] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.733295] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.733370] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.733430] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.733534] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.733659] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.761083] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.761322] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 812.761440] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.761625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-784" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.762113] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-027e596b-f7e6-4c83-9f93-08b2048755ef taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.762308] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-027e596b-f7e6-4c83-9f93-08b2048755ef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.762429] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-027e596b-f7e6-4c83-9f93-08b2048755ef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.762930] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-027e596b-f7e6-4c83-9f93-08b2048755ef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.763122] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027e596b-f7e6-4c83-9f93-08b2048755ef',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.851318] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 812.851318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.851318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.851318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.852969] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.852969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.852969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.852969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.852969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.852969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.852969] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.852969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.852969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.852969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.853553] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.853553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.853553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.853553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.853553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.853553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.853553] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.876060] env[65161]: INFO networking_nsxv3.common.synchronization [req-86a059dd-c9a0-42a6-b913-53338a9463be req-ebdf488f-0c1d-4f70-be5a-5b4417258a71 tempest-ListServersNegativeTestJSON-1190994513 tempest-ListServersNegativeTestJSON-1190994513-project-member] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 812.876060] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGHEST for action security_group_members [ 812.876060] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.876060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.880950] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.880950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.880950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.880950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.880950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.880950] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.880950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.880950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.880950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.880950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.880950] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb already deleted. [ 812.881827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.905371] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.905371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.905371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.905371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.924319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.925088] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd743095-5c04-42e0-a757-109988198d4e is going to be deleted. [ 812.980108] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.980256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.980407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.980555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.980643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.980757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd743095-5c04-42e0-a757-109988198d4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.088427] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.088666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.088666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.088856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.089032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.089137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.089199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.089349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.089434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.089522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.089656] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.095233] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.095439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.095439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.095644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.095828] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.095953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.096034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.096190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.096302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.096357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.096446] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.103517] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.103640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.103640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.103819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.104013] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.104124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.104189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.104366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.104453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.104538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.104625] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.105576] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.105821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.106083] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.106197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.106264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.106417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.106559] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.106654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.106722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.106863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.106944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.107043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.107128] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.108071] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.108215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.108285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.108434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.108576] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.108668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.108788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.108892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.108968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.109063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.109144] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.118213] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.118379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.118455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.119071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.121825] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.121982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.156905] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.157061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.164557] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.164681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.165632] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.165733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.166559] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.166656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.167181] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.168865] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.168979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.170034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.170141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.170912] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.171549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.171802] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.171889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.173608] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.173698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.270154] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.270406] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.270658] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.270948] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.271118] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.271303] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 027e596b-f7e6-4c83-9f93-08b2048755ef not found, creating... [ 813.271581] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.271762] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.271935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.272243] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.276702] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.276702] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.276702] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.276702] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.276702] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.276702] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.276702] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 027e596b-f7e6-4c83-9f93-08b2048755ef is going to be created. [ 813.280386] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.280386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.283708] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 813.284240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.284410] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be deleted. [ 813.286147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.286147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.305799] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.306205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.306266] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.307047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.307047] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.307409] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-027e596b-f7e6-4c83-9f93-08b2048755ef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.315180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.315693] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3151ee71-d6fa-4cda-bd22-0038b5e588ee is going to be deleted. [ 813.316417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.316759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.347779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.347948] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e081805-9c1f-4f53-b736-a7dddaec90b6 is going to be deleted. [ 813.349129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.349350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.363432] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6704a80-3529-40ab-83a5-1a8a6167b498: rpc.has_security_group_logging(os_id): False [ 813.398852] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.398852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.402488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.402760] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be deleted. [ 813.403959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.404224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.410239] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.410239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.471655] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.471888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.511188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.511396] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba07905f-c3ad-48a2-95c0-86b2e0e304c6 is going to be deleted. [ 813.512441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.512663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.577798] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.578013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.578939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.579119] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9daee2fc-9524-40ce-9dad-b50ca4273bc4 is going to be deleted. [ 813.582228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.582228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.612579] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.612734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.612780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.613325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.613533] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.613646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.613712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.613900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.614044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.614156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.614315] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.614409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.614514] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.614613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.614750] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.614841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.614902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.615049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.615127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.615208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.615298] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.616328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.616493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.616600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.616779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.616907] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.617011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.617078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.617247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.617367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.617466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.617613] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.617703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.617764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.617899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.618047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.618141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.618201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.618331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.618407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.618485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.618574] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.619515] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.619625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.619672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.620597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.620597] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.620597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.620597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.620597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.620597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.620597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.621049] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.621049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.621049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.621049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.621204] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.621204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.621204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.621424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.621467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.621553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.621671] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.623361] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.624109] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.670232] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.693679] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.693857] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f835b02-6879-4c48-95a4-22113f8049b5 is going to be deleted. [ 813.694943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.695251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.699723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.699723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.699723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.699723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.720676] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.720894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.725956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.726476] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ad6db30-29dc-46c6-907d-4e2e1d7dd18d is going to be deleted. [ 813.727129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.727535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.804783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.805228] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1dbf9f4-1099-4ece-bc31-dfb21c800cbf is going to be deleted. [ 813.805920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.807034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.859700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.859700] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86add6f1-e722-4f5b-89cc-222fed23d419 is going to be deleted. [ 813.860885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.861304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.892923] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.893180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.894976] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.895092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.916104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.916324] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cd8909e-2253-4a61-b63b-9d668d108bb9 is going to be deleted. [ 813.918120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.918120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.987995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.987995] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7980d5f-c7aa-4292-9189-bc351c994c0f is going to be deleted. [ 813.988393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.988583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.003157] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.003391] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.025412] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.026232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.036177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.036177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.036177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.036177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.036177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.036177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.036177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.036177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.036177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.037691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.038024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.038866] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.039221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.039471] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.041429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.041429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.041429] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 814.042568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.043508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.043508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.043508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.043508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.043903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.044339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.044339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3151ee71-d6fa-4cda-bd22-0038b5e588ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.044473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.044687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.045448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.045448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e081805-9c1f-4f53-b736-a7dddaec90b6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.045448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.045631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.045700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.045918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.047503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.047503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.047503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.047503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba07905f-c3ad-48a2-95c0-86b2e0e304c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.047696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.047854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.047963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.048177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9daee2fc-9524-40ce-9dad-b50ca4273bc4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.048384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.048602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.048716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.048881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ad6db30-29dc-46c6-907d-4e2e1d7dd18d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.049082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.049293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.049411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.049843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f835b02-6879-4c48-95a4-22113f8049b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.050103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.050321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.050443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.050620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1dbf9f4-1099-4ece-bc31-dfb21c800cbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.050787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.050990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.051129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.051292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86add6f1-e722-4f5b-89cc-222fed23d419" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.068414] env[65161]: INFO networking_nsxv3.common.synchronization [req-34713332-c03e-4bf3-9078-d47beacd0a8d req-0595f2af-da69-4528-8d05-ade88151c40b service nova] Enqueued Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGHEST for action security_group_rules [ 814.068685] env[65161]: INFO networking_nsxv3.common.synchronization [req-34713332-c03e-4bf3-9078-d47beacd0a8d req-0595f2af-da69-4528-8d05-ade88151c40b service nova] Enqueued Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGHEST for action security_group_members [ 814.068907] env[65161]: INFO networking_nsxv3.common.synchronization [req-34713332-c03e-4bf3-9078-d47beacd0a8d req-0595f2af-da69-4528-8d05-ade88151c40b service nova] Enqueued Resource ID: 027e596b-f7e6-4c83-9f93-08b2048755ef with Priority: HIGHEST for action port [ 814.069681] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGHEST for action security_group_rules [ 814.069883] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGHEST for action security_group_members [ 814.070044] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 027e596b-f7e6-4c83-9f93-08b2048755ef with Priority: HIGHEST for action port [ 814.070827] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-403126a0-3b4c-4623-8ce4-c311b9739fcb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.071034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.071151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.071504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.071622] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.073143] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-403126a0-3b4c-4623-8ce4-c311b9739fcb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.073336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.073441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.073716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.073954] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.074110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.074206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.074597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.074711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.074821] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.075827] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-027e596b-f7e6-4c83-9f93-08b2048755ef taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.075930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-027e596b-f7e6-4c83-9f93-08b2048755ef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.075999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-027e596b-f7e6-4c83-9f93-08b2048755ef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.076218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-027e596b-f7e6-4c83-9f93-08b2048755ef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.076306] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027e596b-f7e6-4c83-9f93-08b2048755ef',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.087736] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.087952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.088025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.088307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.088400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.088813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cd8909e-2253-4a61-b63b-9d668d108bb9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.123758] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68ff1a7f-59cd-4081-9af0-9322734ba92b: rpc.has_security_group_logging(os_id): False [ 814.125104] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeec6a6a-0263-4e7c-aea8-f50dc769d7fd: rpc.has_security_group_logging(os_id): False [ 814.126224] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b51ab0e8-12bd-4de0-9195-4b7a1c129654: rpc.has_security_group_logging(os_id): False [ 814.127182] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22b5f607-a69e-46b7-93e8-49d4437a6864: rpc.has_security_group_logging(os_id): False [ 814.128042] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d21165f7-b2bc-43ce-8cb7-61f74b45df43: rpc.has_security_group_logging(os_id): False [ 814.156447] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.156654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.156734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.157057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.157196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.157350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7980d5f-c7aa-4292-9189-bc351c994c0f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.175787] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.176084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.176205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.176531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.176686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.176852] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 814.198056] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.198317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.198317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.198407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.201611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.201611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.201611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.201611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.202481] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.202609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.203947] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.203947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.204679] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.204829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.219491] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.219491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.219491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.219491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.219668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.258510] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 814.265471] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 814.266163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.266499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.266771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.266849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.267110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.267211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.267463] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.267586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.267654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.267819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.267896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.268142] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.268243] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.268299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.268431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.268516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.268602] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 814.269773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.269952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.298649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.298649] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.298649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.298649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.298649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.298649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.298649] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be updated. [ 814.300088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.300329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.387370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.388224] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.388224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.388224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.388786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.388786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.388933] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.389052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.389115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.389712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.389712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.389712] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.389712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.389712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.390240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.390353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.390503] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 814.392145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.392324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.392501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.393840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.394286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.428953] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.428953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.435360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.435360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.435360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.435360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.435360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.435609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.435609] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be updated. [ 814.436758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.437065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.441014] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 814.459059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.459059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.491276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.491653] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.491852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.491999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.492597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.492597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.492731] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.492884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.492978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.496676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.497137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.498841] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.499072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.499251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.499529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.499896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.500153] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 814.501756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.502065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.502910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.504082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.504398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.504631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.532387] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 814.534044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: IN_PROGRESS for 2s [ 814.552546] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.552746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.552810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.553315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.553455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.565084] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.565259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.565349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.567062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.567062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.578647] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.581183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-403126a0-3b4c-4623-8ce4-c311b9739fcb taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.581183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.581183] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 027e596b-f7e6-4c83-9f93-08b2048755ef with status ACTIVE [ 814.581464] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.581685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.581685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.581820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.581944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.583939] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.583939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.583939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.583939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.583939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.583939] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.583939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.583939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.584273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.584273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.584273] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 027e596b-f7e6-4c83-9f93-08b2048755ef is going to be updated. [ 814.610425] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: IN_PROGRESS for 2s [ 814.611772] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 814.658797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.658969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.658969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.659174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.659315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.659480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-027e596b-f7e6-4c83-9f93-08b2048755ef" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.660676] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.660805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.660805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.661007] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.661561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.717851] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 815.087076] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.589898] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.590154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.590232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.590455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.590549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.590649] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb is going to be created. [ 815.620854] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.621051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.621096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.622149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.622149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.633614] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb in Status: UNINITIALIZED for 2s [ 816.269037] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 816.269364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.269551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.269789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.270042] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.270152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.270206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.270365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.270449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.270572] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.457895] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 816.458149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.458338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.458570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.458675] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.550066] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 816.550329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.553626] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 816.553817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.628920] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: SUCCESS [ 816.629175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.629989] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 816.630221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.735889] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 816.735889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.775542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.775894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.775894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.777731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.801026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.801444] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.801657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.801896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.802191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.802191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.802329] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 816.829277] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.830347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.830347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.830347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.830347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.843349] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 816.961351] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.961527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.961594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.961877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.961986] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.962133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.962201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.966180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.966295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.966396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.966490] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.471036] env[65161]: INFO networking_nsxv3.common.synchronization [req-87024a06-fa3f-48b2-b8c8-04ad76388ed9 req-d30ef3a5-a38e-4e15-bad1-7a69a90f6242 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_members [ 817.471036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.471036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.471036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.471036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.471036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.471036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.471634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.471634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.471634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.471634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.471634] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.472253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.472253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.472253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.472253] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.472253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.472253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.472504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.472504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.472571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.472656] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.474637] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_members [ 817.475195] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ba62457-a546-42c0-916a-d1efa9c77ee4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.475302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.475363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.475754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.475856] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.475909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.476309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.476309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.476309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.476701] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.643454] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb in Status: SUCCESS [ 817.643568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.643742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.643954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.644171] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.644306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.644352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.644502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.644578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.644672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.644766] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.858760] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.858947] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.859079] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.859351] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.859609] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.859762] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.859876] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.860295] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.861020] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.861020] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.861020] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.861205] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.861262] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.861350] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.861472] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.861606] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.880990] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.881177] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.882387] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.882387] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.882387] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.882387] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.882387] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.882683] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.882683] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3309b96a-15f2-4ac5-b1ec-bae53fb6357d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.975891] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6704a80-3529-40ab-83a5-1a8a6167b498: rpc.has_security_group_logging(os_id): False [ 817.978271] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.978666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.978743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.978964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.979070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.979264] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.979362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.979757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.979836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.979987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.980112] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 already deleted. [ 817.980207] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.997889] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.998063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.998172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.998404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.998513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.998759] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.998881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.998949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.999157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.999290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.999451] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.999574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.999672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.999987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.000232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.000555] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.000707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.000793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.000963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.001073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.001228] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 818.073811] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.073811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.073811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.074037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.074174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.094866] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 818.148173] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-403126a0-3b4c-4623-8ce4-c311b9739fcb taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.148273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.148339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.148561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.148727] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.148827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.148892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.149054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.149143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.149220] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.149369] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-403126a0-3b4c-4623-8ce4-c311b9739fcb taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.149461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.149518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.149676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.149861] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.149977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.149977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.150154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.150234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.150334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.150396] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.385477] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.385477] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.385596] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.385901] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.386037] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.386195] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 3309b96a-15f2-4ac5-b1ec-bae53fb6357d not found, creating... [ 818.386519] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.386678] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.386793] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.387553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.387553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.387553] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.387760] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.388062] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.388335] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.388597] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.388765] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 3309b96a-15f2-4ac5-b1ec-bae53fb6357d is going to be created. [ 818.414416] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.414581] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.414705] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.414980] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.415223] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.415444] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.652549] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 403126a0-3b4c-4623-8ce4-c311b9739fcb: rpc.has_security_group_logging(os_id): False [ 818.724818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.725775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.725775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.725775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.725775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.726309] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.726477] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.726646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.726889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.727073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.727346] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.727501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.727578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.727828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.727895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.728229] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.728613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.728613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.728613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.728740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.728740] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb is going to be created. [ 818.819629] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.819629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.819629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.819629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.819629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.836251] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb in Status: IN_PROGRESS for 2s [ 818.855534] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 818.855732] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 deletion is rescheduled due to dependency. [ 818.856384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.856384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.856384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.856568] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.856568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.856672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.856800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.856853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.856913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.857012] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.244501] env[65161]: INFO networking_nsxv3.common.synchronization [req-87024a06-fa3f-48b2-b8c8-04ad76388ed9 req-17f95f56-3bfe-4a8f-b7de-3d3c2e1c5987 service nova] Enqueued Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_rules [ 819.244723] env[65161]: INFO networking_nsxv3.common.synchronization [req-87024a06-fa3f-48b2-b8c8-04ad76388ed9 req-17f95f56-3bfe-4a8f-b7de-3d3c2e1c5987 service nova] Enqueued Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_members [ 819.244814] env[65161]: INFO networking_nsxv3.common.synchronization [req-87024a06-fa3f-48b2-b8c8-04ad76388ed9 req-17f95f56-3bfe-4a8f-b7de-3d3c2e1c5987 service nova] Enqueued Resource ID: 3309b96a-15f2-4ac5-b1ec-bae53fb6357d with Priority: HIGHEST for action port [ 819.245356] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_rules [ 819.245505] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_members [ 819.245604] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3309b96a-15f2-4ac5-b1ec-bae53fb6357d with Priority: HIGHEST for action port [ 819.245877] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ba62457-a546-42c0-916a-d1efa9c77ee4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.245998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.248347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.248347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.248347] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.249325] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ba62457-a546-42c0-916a-d1efa9c77ee4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.249462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.249516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.249689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.252508] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.252508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.252508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.252508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.252508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.252508] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.252508] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.252508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.252508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.252508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.252508] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3309b96a-15f2-4ac5-b1ec-bae53fb6357d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.363246] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.363357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.363403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.363633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.364320] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.364320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.364320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.364320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.364557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.364557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.364633] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.364710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.364767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.364908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.365082] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.365149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.365219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.365362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.365438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.365531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.365648] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.753591] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.756234] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ba62457-a546-42c0-916a-d1efa9c77ee4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.757826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.759329] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3309b96a-15f2-4ac5-b1ec-bae53fb6357d with status ACTIVE [ 819.759329] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.759329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.759329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.759329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.759329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.759329] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.759917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.760160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.761320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.764065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.764065] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.764065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.764065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.764065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.764065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.764065] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3309b96a-15f2-4ac5-b1ec-bae53fb6357d is going to be updated. [ 819.783590] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.785100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.785100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.785100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.785100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.785100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3309b96a-15f2-4ac5-b1ec-bae53fb6357d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.869795] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06af9b92-f2b2-48b1-bf38-8ca0713490e4: rpc.has_security_group_logging(os_id): False [ 819.892735] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.893107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.893197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.893448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.893530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.893774] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.893899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.894013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.894218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.894327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.894602] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.894733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.894815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.895015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.895104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.895350] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.895457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.895522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.895690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.895770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.895863] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be updated. [ 819.976979] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.977149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.977492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.977492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.977583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.001752] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: IN_PROGRESS for 2s [ 820.120315] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 820.120563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.264912] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.769732] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.769732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.769732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.770217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.770217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.770522] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 is going to be created. [ 820.800459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.800459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.800459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.800459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.800459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.809144] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 in Status: UNINITIALIZED for 2s [ 820.851028] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb in Status: SUCCESS [ 820.851028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.195392] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7c213bc5-6d38-49a0-ac77-c25017617c42 None None] Enqueued Resource ID: 7fa39c94-b355-493f-bbda-d39f30407495 with Priority: HIGHEST for action port [ 821.198928] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa39c94-b355-493f-bbda-d39f30407495 with Priority: HIGHEST for action port [ 821.198928] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fa39c94-b355-493f-bbda-d39f30407495 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.199136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fa39c94-b355-493f-bbda-d39f30407495" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.199196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fa39c94-b355-493f-bbda-d39f30407495" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.199533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fa39c94-b355-493f-bbda-d39f30407495" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.200328] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fa39c94-b355-493f-bbda-d39f30407495',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.702512] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fa39c94-b355-493f-bbda-d39f30407495 [ 821.702897] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.703214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.703214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.703348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.703448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.703647] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fa39c94-b355-493f-bbda-d39f30407495 already deleted. [ 821.703647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fa39c94-b355-493f-bbda-d39f30407495" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.018557] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 in Status: SUCCESS [ 822.018887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.821175] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 in Status: SUCCESS [ 822.821175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.821175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.821175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.821175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.821175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.821175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.821175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.821175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.821175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.821175] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.026455] env[65161]: INFO networking_nsxv3.common.synchronization [None req-cdfe9965-f552-424e-9fca-dbb3ae92f050 tempest-ServersTestFqdnHostnames-1875275343 tempest-ServersTestFqdnHostnames-1875275343-project-member] Enqueued Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_rules [ 823.026940] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_rules [ 823.027275] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c38cb053-aec9-4ead-86a8-4aa3f2154903 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.027396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.027517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.027700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.027818] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.168338] env[65161]: INFO networking_nsxv3.common.synchronization [None req-13cdc6cd-f820-4dc8-9210-82f8aa011174 tempest-ServersTestFqdnHostnames-1875275343 tempest-ServersTestFqdnHostnames-1875275343-project-member] Enqueued Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_rules [ 823.170566] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_rules [ 823.170566] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c38cb053-aec9-4ead-86a8-4aa3f2154903 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.170566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.324332] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.526249] env[65161]: INFO networking_nsxv3.common.synchronization [req-1be1f4b1-55f3-4b3a-b3be-6090dcdc667b req-ab3129e9-bc6b-4f21-99dc-bf45b13996ac tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 823.526768] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 823.527133] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.527287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.527360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.527624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.527775] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.527874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.527939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.528103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.528190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.528322] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.550497] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.550920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.551021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.551219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.551305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.551414] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 already deleted. [ 823.551729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.552040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.552140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.552224] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.638191] env[65161]: INFO networking_nsxv3.common.synchronization [None req-846811c9-f588-447f-ac3d-ccf47b2cdacf None None] Enqueued Resource ID: db71a39d-c589-4927-8ff0-bcb806c94f2f with Priority: HIGHEST for action port [ 823.638976] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db71a39d-c589-4927-8ff0-bcb806c94f2f with Priority: HIGHEST for action port [ 823.641210] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-db71a39d-c589-4927-8ff0-bcb806c94f2f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.642028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db71a39d-c589-4927-8ff0-bcb806c94f2f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.642028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db71a39d-c589-4927-8ff0-bcb806c94f2f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.642435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db71a39d-c589-4927-8ff0-bcb806c94f2f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.643120] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db71a39d-c589-4927-8ff0-bcb806c94f2f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.826624] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ba62457-a546-42c0-916a-d1efa9c77ee4: rpc.has_security_group_logging(os_id): False [ 823.844231] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.844820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.844935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.845223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.845337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.845623] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.845783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.845892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.846115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.846222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.846347] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 is going to be created. [ 823.918876] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.919158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.919319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.919570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.919981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.936402] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 in Status: IN_PROGRESS for 2s [ 824.032164] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.038668] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.038668] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-595" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.038668] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-595" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.038668] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-595" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.038845] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.039179] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.039273] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.039556] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.039837] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.039982] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.040197] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.040260] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.040326] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.040491] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.040549] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.040757] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.065832] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.066017] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 824.066151] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.066329] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-595" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.066687] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-8388d6a0-a757-448e-810c-55389745833f taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.066863] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.066977] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.067323] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.067493] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8388d6a0-a757-448e-810c-55389745833f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.081662] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.081877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.081943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.082236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.082344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.082496] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 already deleted. [ 824.082570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.145555] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db71a39d-c589-4927-8ff0-bcb806c94f2f [ 824.145880] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.145997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.146177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.146436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.146530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.146627] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db71a39d-c589-4927-8ff0-bcb806c94f2f already deleted. [ 824.146710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db71a39d-c589-4927-8ff0-bcb806c94f2f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.534537] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.570926] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.571236] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.571515] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.571834] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.572105] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.572768] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 8388d6a0-a757-448e-810c-55389745833f not found, creating... [ 824.572768] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.572768] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.573335] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.573528] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.573668] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.574210] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.574320] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.574525] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.574715] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.574893] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.575064] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 8388d6a0-a757-448e-810c-55389745833f is going to be created. [ 824.597079] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.597467] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.597694] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.598088] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.598499] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.598901] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.038395] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.038674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.038674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.038889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.038980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.039104] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 825.068301] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.068545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.068545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.069026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.069285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.081493] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 825.154593] env[65161]: INFO networking_nsxv3.common.synchronization [None req-505b0981-30a3-4d11-8fd9-f75a6ad5cadc None None] Enqueued Resource ID: 75335cb8-2555-4df1-af60-a01646036495 with Priority: HIGHEST for action port [ 825.154864] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75335cb8-2555-4df1-af60-a01646036495 with Priority: HIGHEST for action port [ 825.155022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-75335cb8-2555-4df1-af60-a01646036495 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.155147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75335cb8-2555-4df1-af60-a01646036495" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.155212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75335cb8-2555-4df1-af60-a01646036495" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.155486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75335cb8-2555-4df1-af60-a01646036495" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.155599] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75335cb8-2555-4df1-af60-a01646036495',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.310370] env[65161]: INFO networking_nsxv3.common.synchronization [req-1be1f4b1-55f3-4b3a-b3be-6090dcdc667b req-07cac107-8496-4e99-9484-f8fa16758b4b service nova] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 825.310491] env[65161]: INFO networking_nsxv3.common.synchronization [req-1be1f4b1-55f3-4b3a-b3be-6090dcdc667b req-07cac107-8496-4e99-9484-f8fa16758b4b service nova] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 825.310552] env[65161]: INFO networking_nsxv3.common.synchronization [req-1be1f4b1-55f3-4b3a-b3be-6090dcdc667b req-07cac107-8496-4e99-9484-f8fa16758b4b service nova] Enqueued Resource ID: 8388d6a0-a757-448e-810c-55389745833f with Priority: HIGHEST for action port [ 825.314035] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 825.314035] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 825.314035] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8388d6a0-a757-448e-810c-55389745833f with Priority: HIGHEST for action port [ 825.314035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.314035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.314035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.314035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.314035] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.314035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.314035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.314035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8388d6a0-a757-448e-810c-55389745833f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.314035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.314035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.314035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.315101] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8388d6a0-a757-448e-810c-55389745833f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.658358] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75335cb8-2555-4df1-af60-a01646036495 [ 825.658593] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.659333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.659333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.659333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.659333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.659333] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75335cb8-2555-4df1-af60-a01646036495 already deleted. [ 825.659333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75335cb8-2555-4df1-af60-a01646036495" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.814466] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.814567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.818667] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8388d6a0-a757-448e-810c-55389745833f with status ACTIVE [ 825.818933] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.819095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.819176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.819381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.819469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.819647] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.819744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.819806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.819948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.820045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.820209] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.820304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.820363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.820501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.820572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.820654] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8388d6a0-a757-448e-810c-55389745833f is going to be updated. [ 825.847026] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.847026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.847026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.847026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.847026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.847026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.961066] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 in Status: SUCCESS [ 825.961066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.669259] env[65161]: INFO networking_nsxv3.common.synchronization [None req-81922454-2b47-48cc-bed1-79f2c2f3de57 tempest-ServersTestJSON-592902756 tempest-ServersTestJSON-592902756-project-member] Enqueued Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_rules [ 826.670085] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_rules [ 826.670179] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.670324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.670324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.670852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.670852] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.756990] env[65161]: INFO networking_nsxv3.common.synchronization [None req-940dcdd8-b324-4a7b-b938-591194c9a39b tempest-ServersTestJSON-592902756 tempest-ServersTestJSON-592902756-project-member] Enqueued Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_rules [ 826.757303] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_rules [ 826.757582] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.757686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.091362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 827.091567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.092837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.092837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.092837] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.092837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.092837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.092837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.092837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.092837] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.192969] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.192969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.192969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.193499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.193499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.193499] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f already deleted. [ 827.193499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.193680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.193764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.193851] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.527864] env[65161]: INFO networking_nsxv3.common.synchronization [None req-f90ee011-ab93-45fb-a560-091479e11350 None None] Enqueued Resource ID: 86ba675f-2f7a-45ff-9ef1-45e82c7c7997 with Priority: HIGHEST for action port [ 827.528414] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ba675f-2f7a-45ff-9ef1-45e82c7c7997 with Priority: HIGHEST for action port [ 827.528792] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ba675f-2f7a-45ff-9ef1-45e82c7c7997 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.528914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ba675f-2f7a-45ff-9ef1-45e82c7c7997" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.528996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ba675f-2f7a-45ff-9ef1-45e82c7c7997" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.529272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ba675f-2f7a-45ff-9ef1-45e82c7c7997" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.529357] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ba675f-2f7a-45ff-9ef1-45e82c7c7997',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.594737] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.720047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.720383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.720383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.720739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.720739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.720739] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f already deleted. [ 827.720888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.032432] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86ba675f-2f7a-45ff-9ef1-45e82c7c7997 [ 828.032650] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.032986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.033198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.033883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.033883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.033883] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86ba675f-2f7a-45ff-9ef1-45e82c7c7997 already deleted. [ 828.033883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ba675f-2f7a-45ff-9ef1-45e82c7c7997" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.098189] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.601458] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.601458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.601458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.601458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.601458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.601777] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 828.636615] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.636839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.636949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.637276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.637496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.647083] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 829.829191] env[65161]: INFO networking_nsxv3.common.synchronization [req-51e1ed8f-6433-4d34-bdb1-2f86a050e459 req-848c3870-4df0-4806-8291-3da63d831fef tempest-ServerAddressesTestJSON-1411495363 tempest-ServerAddressesTestJSON-1411495363-project-member] Enqueued Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGHEST for action security_group_members [ 829.829786] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGHEST for action security_group_members [ 829.830147] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-403126a0-3b4c-4623-8ce4-c311b9739fcb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.830294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.830371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.831038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.831038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.831038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.831038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.831038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.831296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.831296] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.333108] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.333322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.333322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.333558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.333645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.333838] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.333947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.334016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.334169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.334248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.334336] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb is going to be updated. [ 830.386790] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.386790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.386790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.386790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.386790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.396753] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb in Status: IN_PROGRESS for 2s [ 830.658843] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 830.659086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.659270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.659505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.659703] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.659819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.659887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.660087] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.660171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.660258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.660352] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.164056] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.164056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.164056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.164056] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.164056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.164604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.164604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.164604] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.164817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.164817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.164817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.164952] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.165098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.165168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.165325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.165384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.165465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.165620] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.668074] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeec6a6a-0263-4e7c-aea8-f50dc769d7fd: rpc.has_security_group_logging(os_id): False [ 831.688884] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.689095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.689183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.689461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.689633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.689938] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.690350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.690350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.690451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.690484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.690753] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.690884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.690974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.691203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.691315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.691574] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.691705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.691795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.691993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.692125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.692247] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 831.765231] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.765231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.765231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.765231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.765231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.783044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 832.407958] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb in Status: SUCCESS [ 832.408453] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb deletion is rescheduled due to dependency. [ 832.408453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.079819] env[65161]: INFO networking_nsxv3.common.synchronization [req-93c2aaca-0f6d-4778-a0af-a638cc3ff38f req-9ae3eca1-e79e-4ce2-87d2-ba20eb12f8b6 tempest-ServerAddressesNegativeTestJSON-1511101142 tempest-ServerAddressesNegativeTestJSON-1511101142-project-member] Enqueued Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGHEST for action security_group_members [ 833.080504] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGHEST for action security_group_members [ 833.081829] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-39430947-bbef-4608-bea6-00bd7d06d13b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.081829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.081829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.081829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.081829] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.081829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.081829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.081829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.082208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.082208] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.148522] env[65161]: INFO networking_nsxv3.common.synchronization [None req-dc1d4b13-24da-4980-9453-4e24dd261f46 None None] Enqueued Resource ID: 7797a030-f446-4f8b-aecc-ba8618fab129 with Priority: HIGHEST for action port [ 833.148522] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7797a030-f446-4f8b-aecc-ba8618fab129 with Priority: HIGHEST for action port [ 833.148522] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7797a030-f446-4f8b-aecc-ba8618fab129 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.148701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7797a030-f446-4f8b-aecc-ba8618fab129" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.148701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7797a030-f446-4f8b-aecc-ba8618fab129" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.149231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7797a030-f446-4f8b-aecc-ba8618fab129" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.149231] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7797a030-f446-4f8b-aecc-ba8618fab129',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.490738] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-415 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.491153] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-415" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.491153] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-415" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.492218] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-415" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.492218] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.492218] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.492218] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.493214] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.493557] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.493800] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.493998] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.494221] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.494420] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.494577] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.494756] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.494933] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.515876] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.516063] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 833.516205] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.516434] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-415" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.516794] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-98d8d842-4e12-4509-99bb-5e2391731a8f taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.516981] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-98d8d842-4e12-4509-99bb-5e2391731a8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.517106] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-98d8d842-4e12-4509-99bb-5e2391731a8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.517445] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-98d8d842-4e12-4509-99bb-5e2391731a8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.517588] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d8d842-4e12-4509-99bb-5e2391731a8f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.584802] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.585050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.585050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.585245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.585343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.585576] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.585710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.585780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.585888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.585960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.586608] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39430947-bbef-4608-bea6-00bd7d06d13b already deleted. [ 833.586608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.651215] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7797a030-f446-4f8b-aecc-ba8618fab129 [ 833.651476] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.651609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.651676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.651884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.651971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.652138] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7797a030-f446-4f8b-aecc-ba8618fab129 already deleted. [ 833.652269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7797a030-f446-4f8b-aecc-ba8618fab129" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.801852] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 833.802071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.020623] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.020738] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.021255] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.021255] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.021399] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.021435] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 98d8d842-4e12-4509-99bb-5e2391731a8f not found, creating... [ 834.021716] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.021950] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.021995] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.022621] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.022621] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.023032] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.023250] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.023432] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.023740] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.023872] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.024502] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 98d8d842-4e12-4509-99bb-5e2391731a8f is going to be created. [ 834.055569] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.055863] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.056034] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.056561] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.056935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.057681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-98d8d842-4e12-4509-99bb-5e2391731a8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.759412] env[65161]: INFO networking_nsxv3.common.synchronization [req-93c2aaca-0f6d-4778-a0af-a638cc3ff38f req-b14a5e85-6f66-46b7-9dae-65f17530cde2 service nova] Enqueued Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGHEST for action security_group_rules [ 834.759677] env[65161]: INFO networking_nsxv3.common.synchronization [req-93c2aaca-0f6d-4778-a0af-a638cc3ff38f req-b14a5e85-6f66-46b7-9dae-65f17530cde2 service nova] Enqueued Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGHEST for action security_group_members [ 834.759735] env[65161]: INFO networking_nsxv3.common.synchronization [req-93c2aaca-0f6d-4778-a0af-a638cc3ff38f req-b14a5e85-6f66-46b7-9dae-65f17530cde2 service nova] Enqueued Resource ID: 98d8d842-4e12-4509-99bb-5e2391731a8f with Priority: HIGHEST for action port [ 834.760751] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGHEST for action security_group_rules [ 834.760751] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGHEST for action security_group_members [ 834.760751] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d8d842-4e12-4509-99bb-5e2391731a8f with Priority: HIGHEST for action port [ 834.760751] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39430947-bbef-4608-bea6-00bd7d06d13b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.760959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.760959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.761270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.761352] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.762392] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-39430947-bbef-4608-bea6-00bd7d06d13b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.762392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.762392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.762587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.762846] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.763939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.763939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.763939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.763939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.763939] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.764455] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d8d842-4e12-4509-99bb-5e2391731a8f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.764455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d8d842-4e12-4509-99bb-5e2391731a8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.764595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d8d842-4e12-4509-99bb-5e2391731a8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.765510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d8d842-4e12-4509-99bb-5e2391731a8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.765510] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d8d842-4e12-4509-99bb-5e2391731a8f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.266447] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-39430947-bbef-4608-bea6-00bd7d06d13b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.266655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.266706] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98d8d842-4e12-4509-99bb-5e2391731a8f with status ACTIVE [ 835.266841] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.266936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.267073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.267310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.267310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.267474] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.267569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.267624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.267773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.267872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.268028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.268121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.268182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.268382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.268509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.268601] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98d8d842-4e12-4509-99bb-5e2391731a8f is going to be updated. [ 835.270515] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.294185] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.294385] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.294502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.294642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.294802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.294938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d8d842-4e12-4509-99bb-5e2391731a8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.316385] env[65161]: INFO networking_nsxv3.common.synchronization [None req-a42fedb6-c530-4a0f-b49c-22f4e3759023 None None] Enqueued Resource ID: e003eeda-b3ff-4632-bfb0-121b689dd0a3 with Priority: HIGHEST for action port [ 835.317109] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e003eeda-b3ff-4632-bfb0-121b689dd0a3 with Priority: HIGHEST for action port [ 835.317428] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e003eeda-b3ff-4632-bfb0-121b689dd0a3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.317552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e003eeda-b3ff-4632-bfb0-121b689dd0a3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.317619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e003eeda-b3ff-4632-bfb0-121b689dd0a3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.317874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e003eeda-b3ff-4632-bfb0-121b689dd0a3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.317947] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e003eeda-b3ff-4632-bfb0-121b689dd0a3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.775151] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.824116] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e003eeda-b3ff-4632-bfb0-121b689dd0a3 [ 835.824116] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.824116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.824116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.824116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.824116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.824116] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e003eeda-b3ff-4632-bfb0-121b689dd0a3 already deleted. [ 835.824116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e003eeda-b3ff-4632-bfb0-121b689dd0a3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.277860] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.278326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.278402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.278621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.278711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.278814] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39430947-bbef-4608-bea6-00bd7d06d13b is going to be created. [ 836.306621] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.306817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.306817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.307040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.307233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.319020] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39430947-bbef-4608-bea6-00bd7d06d13b in Status: UNINITIALIZED for 2s [ 836.422343] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ea105fc-f2d6-4f58-80d4-3ed031fd3e91 req-645007b1-d82b-4c04-95c1-a1ece9ca0fa3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 836.422441] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ea105fc-f2d6-4f58-80d4-3ed031fd3e91 req-645007b1-d82b-4c04-95c1-a1ece9ca0fa3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 836.422963] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 836.423519] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 836.423756] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.423843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.423943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.424241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.424412] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.424548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.424595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.424735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.424822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.424918] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.425804] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-18989f05-451d-43b2-a58b-a4fd8b8c86b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.425914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.425981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.426370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.426804] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.426962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.427099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.427286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.427377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.427496] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.470092] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ea105fc-f2d6-4f58-80d4-3ed031fd3e91 req-645007b1-d82b-4c04-95c1-a1ece9ca0fa3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_rules [ 836.470282] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ea105fc-f2d6-4f58-80d4-3ed031fd3e91 req-645007b1-d82b-4c04-95c1-a1ece9ca0fa3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 836.470418] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ea105fc-f2d6-4f58-80d4-3ed031fd3e91 req-645007b1-d82b-4c04-95c1-a1ece9ca0fa3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 836.470543] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ea105fc-f2d6-4f58-80d4-3ed031fd3e91 req-645007b1-d82b-4c04-95c1-a1ece9ca0fa3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 836.470667] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ea105fc-f2d6-4f58-80d4-3ed031fd3e91 req-645007b1-d82b-4c04-95c1-a1ece9ca0fa3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 8388d6a0-a757-448e-810c-55389745833f with Priority: HIGHEST for action port [ 836.471632] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_rules [ 836.471772] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 836.471872] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8388d6a0-a757-448e-810c-55389745833f with Priority: HIGHEST for action port [ 836.471964] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 836.472289] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 836.472514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.472642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.472811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.472966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.473147] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.473948] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.474085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.474154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.474337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.474431] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.475993] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8388d6a0-a757-448e-810c-55389745833f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.475993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.475993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.475993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.475993] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8388d6a0-a757-448e-810c-55389745833f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.476401] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-18989f05-451d-43b2-a58b-a4fd8b8c86b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.476456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.476648] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.476736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.929273] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.930254] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.977839] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.979030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.979030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-18989f05-451d-43b2-a58b-a4fd8b8c86b5 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.979030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.979030] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8388d6a0-a757-448e-810c-55389745833f with status ACTIVE [ 836.979335] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.979487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.979574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.979848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.979975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.980189] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.980292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.980350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.980520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.980598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.982167] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.982167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.982167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.982167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.982167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.982167] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8388d6a0-a757-448e-810c-55389745833f is going to be updated. [ 837.005404] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.005597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.005698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.005967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.006160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.006383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.431924] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.433535] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.935286] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.935691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.935691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.935691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.936288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.936288] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 837.937200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.937362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.937402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.937544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.937621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.937710] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 is going to be created. [ 837.965592] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.965786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.965853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.966071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.966199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.969050] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.969235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.969235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.969380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.969527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.978522] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 in Status: UNINITIALIZED for 2s [ 837.980879] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 838.083800] env[65161]: INFO networking_nsxv3.common.synchronization [req-effada4e-6181-4c5d-8e5d-bc6066631d1c req-a40fb47e-fd88-4634-98ac-42866eabd999 tempest-ServersAdminTestJSON-2133010713 tempest-ServersAdminTestJSON-2133010713-project-member] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 838.084332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 838.087459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.087459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.087459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.087459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.087459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.087459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.087459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.087459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.087459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.087459] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.331790] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39430947-bbef-4608-bea6-00bd7d06d13b in Status: SUCCESS [ 838.332130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.332250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.332508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.332693] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.332794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.332838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.332977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.333283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.333283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.333283] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.589041] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.835816] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-39430947-bbef-4608-bea6-00bd7d06d13b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.836219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.836356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.836742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.836933] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.837130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.837224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.838065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.838188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.838328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.838571] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-39430947-bbef-4608-bea6-00bd7d06d13b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.838710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.838779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.838968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.839167] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.839312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.839439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.839554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.839655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.839797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.839865] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.090467] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.342789] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39430947-bbef-4608-bea6-00bd7d06d13b: rpc.has_security_group_logging(os_id): False [ 839.362212] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.362212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.362212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.362212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.362212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.362508] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.362623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.362744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.362912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.362912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.363082] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.363175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.363231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.363368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.363470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.363631] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.363750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.363812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.363950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.364048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.364139] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39430947-bbef-4608-bea6-00bd7d06d13b is going to be created. [ 839.428999] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.428999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.428999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.428999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.428999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.445278] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39430947-bbef-4608-bea6-00bd7d06d13b in Status: IN_PROGRESS for 2s [ 839.593234] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.593420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.593420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.593563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.593656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.593749] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 839.630793] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.630922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.630959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.631367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.631622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.643358] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 839.993781] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 in Status: SUCCESS [ 839.994011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.994748] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 839.994981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.995079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.995808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.995808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.995808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.995808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.995808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.996233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.996233] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.996733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.996901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.997072] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.997171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.997238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.997370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.997448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.997557] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.500146] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.501247] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.834313] env[65161]: INFO networking_nsxv3.common.synchronization [req-6f23180f-c83c-4e2b-9637-21a875bb3ff0 req-7847926f-f165-4432-813f-faf5e65c8f90 tempest-ListServerFiltersTestJSON-655968173 tempest-ListServerFiltersTestJSON-655968173-project-member] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 840.834313] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 840.834313] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.834313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.834313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.835878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.836368] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.836845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.838032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.838032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.838032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.838032] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.003960] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.004985] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.339713] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.461349] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39430947-bbef-4608-bea6-00bd7d06d13b in Status: SUCCESS [ 841.461579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.506798] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.507049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.507049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.507423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.507524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.507718] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 is going to be updated. [ 841.509878] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.509986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.510172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.510245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.510435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.510435] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 841.541047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.541047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.541047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.541289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.541346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.543902] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.544039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.544039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.544255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.544382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.554990] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 in Status: IN_PROGRESS for 2s [ 841.555776] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 841.655275] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 841.655275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.842128] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.345088] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.345347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.345426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.345738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.345870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.345976] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 842.377031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.377209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.377271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.377466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.377629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.387088] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 842.906352] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 842.906605] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 842.906794] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 606ef24e-621d-44db-ae96-af5410c58de6 with Priority: HIGHEST for action security_group_members [ 842.907346] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 842.907443] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 842.907528] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ef24e-621d-44db-ae96-af5410c58de6 with Priority: HIGHEST for action security_group_members [ 842.907799] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.907891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.908067] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-18989f05-451d-43b2-a58b-a4fd8b8c86b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.908152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.908322] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-606ef24e-621d-44db-ae96-af5410c58de6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.908418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.908482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.908740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.908894] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.908991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.909065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.909214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.909304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.909384] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.954303] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_rules [ 842.954479] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 842.954613] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 606ef24e-621d-44db-ae96-af5410c58de6 with Priority: HIGHEST for action security_group_rules [ 842.954738] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 606ef24e-621d-44db-ae96-af5410c58de6 with Priority: HIGHEST for action security_group_members [ 842.954861] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 842.954991] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 842.955207] env[65161]: INFO networking_nsxv3.common.synchronization [req-579e8739-6579-444a-877b-88f7ce7de4f5 req-a0bd8c4c-e33e-47b4-abf3-6b55ed9f71b3 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 8388d6a0-a757-448e-810c-55389745833f with Priority: HIGHEST for action port [ 842.955703] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_rules [ 842.955831] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ef24e-621d-44db-ae96-af5410c58de6 with Priority: HIGHEST for action security_group_rules [ 842.955923] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 842.956025] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8388d6a0-a757-448e-810c-55389745833f with Priority: HIGHEST for action port [ 842.956119] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_rules [ 842.956207] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 842.956308] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ef24e-621d-44db-ae96-af5410c58de6 with Priority: HIGHEST for action security_group_members [ 842.956601] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.956718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.956945] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606ef24e-621d-44db-ae96-af5410c58de6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.957066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.957149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.957591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.957702] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.958647] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.958761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.958991] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8388d6a0-a757-448e-810c-55389745833f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.959137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.959244] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.959417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.959497] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8388d6a0-a757-448e-810c-55389745833f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.960378] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.960481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.960604] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-18989f05-451d-43b2-a58b-a4fd8b8c86b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.960699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.960883] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-606ef24e-621d-44db-ae96-af5410c58de6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.961093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.412830] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.462402] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8388d6a0-a757-448e-810c-55389745833f with status ACTIVE [ 843.462554] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.462554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.462661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.462836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.462928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.463113] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.463246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.463290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.463544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.463544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.463672] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.463740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.463847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.463936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.464059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.464108] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8388d6a0-a757-448e-810c-55389745833f is going to be updated. [ 843.465603] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-606ef24e-621d-44db-ae96-af5410c58de6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.465720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.485855] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.485855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.485855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.486416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.486416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.486416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8388d6a0-a757-448e-810c-55389745833f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.569126] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 843.569453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.570426] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 in Status: SUCCESS [ 843.570602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.570765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.570973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.571183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.571379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.571379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.571531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.571586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.571669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.571768] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.572694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.572862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.573036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.573204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.573289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.573797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.573797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.573797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.573797] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.575045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.575045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.575183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.575242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.575394] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.575503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.575563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.575614] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.576809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.576809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.576971] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.576971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.577321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.577321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.577321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.577321] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.915556] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.075538] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.075538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.081211] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.082153] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.083226] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.330036] env[65161]: INFO networking_nsxv3.common.synchronization [req-556a2e1d-0737-49bb-a347-13179299c0cc req-efe1b776-ccea-4dd5-8052-f92c45b3d94b tempest-ServerAddressesNegativeTestJSON-1511101142 tempest-ServerAddressesNegativeTestJSON-1511101142-project-member] Enqueued Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGHEST for action security_group_members [ 844.330595] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGHEST for action security_group_members [ 844.330902] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-39430947-bbef-4608-bea6-00bd7d06d13b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.331036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.331106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.331312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.331462] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.331556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.331619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.331760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.331844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.331937] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.396809] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 844.397261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.418416] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.418613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.418613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.418824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.418913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.419038] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606ef24e-621d-44db-ae96-af5410c58de6 is going to be created. [ 844.444929] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.445101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.445160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.445351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.445509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.457834] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606ef24e-621d-44db-ae96-af5410c58de6 in Status: UNINITIALIZED for 2s [ 844.584974] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.585920] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18989f05-451d-43b2-a58b-a4fd8b8c86b5: rpc.has_security_group_logging(os_id): False [ 844.586952] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.611625] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.611825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.611825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.612054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.612219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.612456] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.612555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.612617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.612776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.612852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.612938] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 is going to be created. [ 844.670039] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.670039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.670039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.670039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.670039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.683771] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 in Status: IN_PROGRESS for 2s [ 844.834404] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.834404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.834404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.834683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.834683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.834841] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.834930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.834987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.835156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.835282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.835335] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39430947-bbef-4608-bea6-00bd7d06d13b is going to be updated. [ 844.873028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.873246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.873246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.873441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.873586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.884237] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39430947-bbef-4608-bea6-00bd7d06d13b in Status: IN_PROGRESS for 2s [ 845.089112] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.089112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.089112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.089557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.089557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.089557] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 is going to be updated. [ 845.090748] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.090861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.090929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.091115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.091197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.091284] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 845.120364] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.120622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.120622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.120907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.121044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.123027] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.123188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.123255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.123501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.123682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.134995] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 845.136061] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 in Status: IN_PROGRESS for 2s [ 845.902164] env[65161]: INFO networking_nsxv3.common.synchronization [req-9678e456-d3c2-4f5e-8746-f56baaba2e6d req-6c100a5e-961f-450f-a1a1-26b804eaa499 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 845.902352] env[65161]: INFO networking_nsxv3.common.synchronization [req-9678e456-d3c2-4f5e-8746-f56baaba2e6d req-6c100a5e-961f-450f-a1a1-26b804eaa499 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 845.902484] env[65161]: INFO networking_nsxv3.common.synchronization [req-9678e456-d3c2-4f5e-8746-f56baaba2e6d req-6c100a5e-961f-450f-a1a1-26b804eaa499 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: 606ef24e-621d-44db-ae96-af5410c58de6 with Priority: HIGHEST for action security_group_members [ 845.903152] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 845.903300] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 with Priority: HIGHEST for action security_group_members [ 845.903444] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ef24e-621d-44db-ae96-af5410c58de6 with Priority: HIGHEST for action security_group_members [ 845.903797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.903927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.904188] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-18989f05-451d-43b2-a58b-a4fd8b8c86b5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.904297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.904520] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-606ef24e-621d-44db-ae96-af5410c58de6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.904624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.468621] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606ef24e-621d-44db-ae96-af5410c58de6 in Status: SUCCESS [ 846.468621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.468621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.468621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.468621] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.469120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.469120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.469120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.469120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.469120] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.693883] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 in Status: SUCCESS [ 846.694125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.694291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.694506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.694594] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.896731] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39430947-bbef-4608-bea6-00bd7d06d13b in Status: SUCCESS [ 846.896731] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39430947-bbef-4608-bea6-00bd7d06d13b deletion is rescheduled due to dependency. [ 846.896731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.972017] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.972225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.972302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.972525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.972622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.972807] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.972899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.972964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.973148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.973342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.973380] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606ef24e-621d-44db-ae96-af5410c58de6 is going to be deleted. [ 847.015016] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.015189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.015265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.015505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.015610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.015722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.016026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.016111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.016364] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.016535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.016535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.016630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.016712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.016807] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.146111] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 in Status: SUCCESS [ 847.146488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.146488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.146621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.146780] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.146906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.146970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.147136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.147219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.147337] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.148919] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 847.148919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.149090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.149879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.149879] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.149879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.149879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.149879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.149879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.149879] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.214388] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.214586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.214637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.214812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.214901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.214998] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 is going to be deleted. [ 847.277040] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.277040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.277040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.277299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.277386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.277514] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.519724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.519724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.520181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.520181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.520181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.520329] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.520432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.520489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.520642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.520719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.520801] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606ef24e-621d-44db-ae96-af5410c58de6 already deleted. [ 847.520880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.520976] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.521911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.522060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.522267] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.522388] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.522430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.523467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.523467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.523467] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.652047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.652255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.652331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.652613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.652779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.653443] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.653443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.653443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.653443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.653443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.653443] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 is going to be deleted. [ 847.655031] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.683595] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.683809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.683889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.684130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.684232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.684376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.684534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.684699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.684882] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.684985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.685076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.685191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.685266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.685365] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18989f05-451d-43b2-a58b-a4fd8b8c86b5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.025356] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('606ef24e-621d-44db-ae96-af5410c58de6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.027040] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.027199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.027277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.027520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.027922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.027922] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.028179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.028179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.028342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.028342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.028442] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606ef24e-621d-44db-ae96-af5410c58de6 already deleted. [ 848.028527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.158016] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.187699] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.187899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.187945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.188172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.188264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.188459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.188556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.188619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.188767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.188843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.188928] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18989f05-451d-43b2-a58b-a4fd8b8c86b5 already deleted. [ 848.189014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18989f05-451d-43b2-a58b-a4fd8b8c86b5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.529711] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 606ef24e-621d-44db-ae96-af5410c58de6: rpc.has_security_group_logging(os_id): False [ 848.547438] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.547596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.547667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.547871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.547960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.548223] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.548368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.548425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.548565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.548645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.548732] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606ef24e-621d-44db-ae96-af5410c58de6 is going to be created. [ 848.570041] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/606ef24e-621d-44db-ae96-af5410c58de6], does not exist path=[/infra/domains/default/groups/606ef24e-621d-44db-ae96-af5410c58de6]."\n}' [ 848.570041] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606ef24e-621d-44db-ae96-af5410c58de6 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/606ef24e-621d-44db-ae96-af5410c58de6 [ 848.570041] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 848.598099] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.598297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.598353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.598536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.599297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.599542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.599684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.599736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.600115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.600225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.600428] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.600526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.600592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.600736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.600812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.600897] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606ef24e-621d-44db-ae96-af5410c58de6 is going to be created. [ 848.616745] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/606ef24e-621d-44db-ae96-af5410c58de6], does not exist path=[/infra/domains/default/groups/606ef24e-621d-44db-ae96-af5410c58de6]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/606ef24e-621d-44db-ae96-af5410c58de6 [ 848.617619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606ef24e-621d-44db-ae96-af5410c58de6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.617619] env[65161]: Traceback (most recent call last): [ 848.617619] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 848.617619] env[65161]: return func(*args, **kwargs) [ 848.617619] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 848.617619] env[65161]: res.raise_for_status() [ 848.617619] env[65161]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 848.617619] env[65161]: raise HTTPError(http_error_msg, response=self) [ 848.617619] env[65161]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/606ef24e-621d-44db-ae96-af5410c58de6 [ 848.617619] env[65161]: During handling of the above exception, another exception occurred: [ 848.617619] env[65161]: Traceback (most recent call last): [ 848.617619] env[65161]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 848.617619] env[65161]: listener.cb(fileno) [ 848.617619] env[65161]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 848.617619] env[65161]: result = function(*args, **kwargs) [ 848.617619] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 848.617619] env[65161]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 848.617619] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 848.617619] env[65161]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 848.617619] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 848.617619] env[65161]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 848.617619] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 848.617619] env[65161]: res.raise_for_status() [ 848.617619] env[65161]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 848.617619] env[65161]: raise HTTPError(http_error_msg, response=self) [ 848.617619] env[65161]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/606ef24e-621d-44db-ae96-af5410c58de6 [ 848.617619] env[65161]: Removing descriptor: 59 [ 848.661294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.661294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.661294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.661550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.661587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.661973] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 848.691341] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.691490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.691561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.691773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.691919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.701280] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 850.716032] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 850.716032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.716032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.716423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.716423] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.716532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.716569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.716773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.716773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.716877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.717039] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.717099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.717161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.717287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.717562] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.717562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.717562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.717727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.717727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.717802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.718737] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.718737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.719197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.719197] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.719197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.719197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.719399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.719399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.719481] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.905028] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 850.905028] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 851.220664] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeec6a6a-0263-4e7c-aea8-f50dc769d7fd: rpc.has_security_group_logging(os_id): False [ 851.221824] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.240179] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.240179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.240950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.240950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.266097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.266356] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.266476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.266544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.266739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.266820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.267044] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.267152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.267216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.267365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.267443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.267643] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.267740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.267799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.267933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.268016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.268106] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 851.334144] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.334561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.334661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.334843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.334988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.347543] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 851.724204] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.226845] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.228323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.228323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.228323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.228323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.228323] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 852.259834] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.260038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.260200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.260419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.260566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.270234] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 853.362962] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 853.362962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.362962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.362962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.363710] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.865674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.865674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.261619] env[65161]: INFO networking_nsxv3.common.synchronization [req-58426280-3416-4b76-8511-010ae4d08dba req-b35dedc1-2003-4967-9487-bcb57793eb0f tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_members [ 854.262301] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_members [ 854.262736] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.262918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.263221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.263378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.263712] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.263838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.263921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.264149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.264273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.264397] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.280647] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 854.280922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.281120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.281386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.281673] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.281805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.281864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.282033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.282131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.282238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.282307] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.559638] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.560414] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.560696] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.561428] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.565080] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.565080] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.565080] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.565080] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.565080] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.565080] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.565080] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.565080] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.565080] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.565080] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.565080] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.565080] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.584520] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.585408] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.585408] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.585408] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.585408] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-3654a5d6-a290-47b8-81f9-57167f68ea36 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.585681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-3654a5d6-a290-47b8-81f9-57167f68ea36" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.585681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-3654a5d6-a290-47b8-81f9-57167f68ea36" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.585911] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-3654a5d6-a290-47b8-81f9-57167f68ea36" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.586073] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3654a5d6-a290-47b8-81f9-57167f68ea36',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.767547] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.767547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.767547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.767547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.767547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.767547] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.767879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.767879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.767879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.767879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.768028] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c already deleted. [ 854.768028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.787831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.787831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.787831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.788516] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.788516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.788516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.788516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.788516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.788786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.788786] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.088758] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.089060] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.089235] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.089596] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.089781] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.089955] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 3654a5d6-a290-47b8-81f9-57167f68ea36 not found, creating... [ 855.090305] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.090487] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.090613] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.090865] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.091076] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.091399] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.091580] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.091701] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.091932] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.092088] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.092273] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 3654a5d6-a290-47b8-81f9-57167f68ea36 is going to be created. [ 855.113309] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.113536] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.113660] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.113948] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.114198] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.114425] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-3654a5d6-a290-47b8-81f9-57167f68ea36" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.291833] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aeec6a6a-0263-4e7c-aea8-f50dc769d7fd: rpc.has_security_group_logging(os_id): False [ 855.316746] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.316900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.316973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.317231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.317336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.317536] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.317639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.317700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.317856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.317934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.318170] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.318270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.318364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.318471] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.318546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.318726] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.318818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.318890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.319021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.319093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.319240] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 855.450879] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.451081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.451197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.451418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.451643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.467231] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 855.829783] env[65161]: INFO networking_nsxv3.common.synchronization [req-58426280-3416-4b76-8511-010ae4d08dba req-f1af62f6-fdde-463f-8847-0458c78ad5ad service nova] Enqueued Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_rules [ 855.829783] env[65161]: INFO networking_nsxv3.common.synchronization [req-58426280-3416-4b76-8511-010ae4d08dba req-f1af62f6-fdde-463f-8847-0458c78ad5ad service nova] Enqueued Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_members [ 855.829783] env[65161]: INFO networking_nsxv3.common.synchronization [req-58426280-3416-4b76-8511-010ae4d08dba req-f1af62f6-fdde-463f-8847-0458c78ad5ad service nova] Enqueued Resource ID: 3654a5d6-a290-47b8-81f9-57167f68ea36 with Priority: HIGHEST for action port [ 855.829783] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_rules [ 855.829783] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_members [ 855.829783] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3654a5d6-a290-47b8-81f9-57167f68ea36 with Priority: HIGHEST for action port [ 855.829783] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.830551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.830551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.830551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.830551] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.831373] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.831421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.831492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.831643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.832262] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.832518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.832518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.832589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.832689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.832837] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.834924] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-3654a5d6-a290-47b8-81f9-57167f68ea36 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.834924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3654a5d6-a290-47b8-81f9-57167f68ea36" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.834924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3654a5d6-a290-47b8-81f9-57167f68ea36" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.834924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3654a5d6-a290-47b8-81f9-57167f68ea36" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.834924] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3654a5d6-a290-47b8-81f9-57167f68ea36',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.335452] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.335600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.336898] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3654a5d6-a290-47b8-81f9-57167f68ea36 with status ACTIVE [ 856.337083] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.337195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.337264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.337472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.337557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.337724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.337829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.337866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.338029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.338106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.338282] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.338372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.338430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.339116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.339116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.339116] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3654a5d6-a290-47b8-81f9-57167f68ea36 is going to be updated. [ 856.340292] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.361399] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.361569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.361614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.361802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.361936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.362111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3654a5d6-a290-47b8-81f9-57167f68ea36" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.842948] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.885334] env[65161]: INFO networking_nsxv3.common.synchronization [req-d7b16645-1004-48c1-b61b-93cca0f51c5c req-1d0552db-c062-4723-9f3f-5b560229b54f tempest-ServerMetadataNegativeTestJSON-1238484076 tempest-ServerMetadataNegativeTestJSON-1238484076-project-member] Enqueued Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGHEST for action security_group_members [ 856.885334] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGHEST for action security_group_members [ 856.885334] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-31b969f0-436d-400e-8475-a05d3168335c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.885334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.885334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.885334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.885782] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.885782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.885782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.886135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.886135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.886135] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.279073] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-906 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.279231] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-906" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.279459] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-906" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.279756] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-906" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.279987] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.280181] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.280276] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.280486] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.280702] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.280828] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.280955] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.281082] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.281181] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.281287] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.281387] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.281514] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.301457] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.301457] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.301600] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.301740] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-906" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.302063] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.302287] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.302585] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.302810] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.302984] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('203f1d3f-6a4d-44ea-b61e-4a7f20df206b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.345656] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.346121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.346792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.346792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.346792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.346792] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c is going to be created. [ 857.371322] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.371322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.371322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.371495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.371530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.382214] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d910b0-5a99-40f2-ba32-49a643c7766c in Status: UNINITIALIZED for 2s [ 857.388010] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.388161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.388232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.388430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.388517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.388921] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.388921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.388921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.389092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.389127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.389201] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31b969f0-436d-400e-8475-a05d3168335c already deleted. [ 857.389256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.481199] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 857.482384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.809972] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.809972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.809972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.809972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.809972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.809972] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 203f1d3f-6a4d-44ea-b61e-4a7f20df206b not found, creating... [ 857.809972] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.809972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.809972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.809972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.809972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.810625] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.810625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.810743] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.810994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.811369] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.811550] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 203f1d3f-6a4d-44ea-b61e-4a7f20df206b is going to be created. [ 857.834829] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.835096] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.835222] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.835501] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.835734] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.835960] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.544175] env[65161]: INFO networking_nsxv3.common.synchronization [req-d7b16645-1004-48c1-b61b-93cca0f51c5c req-85dc8731-1a02-49ed-b9a1-7dca40d40ab1 service nova] Enqueued Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGHEST for action security_group_rules [ 858.544387] env[65161]: INFO networking_nsxv3.common.synchronization [req-d7b16645-1004-48c1-b61b-93cca0f51c5c req-85dc8731-1a02-49ed-b9a1-7dca40d40ab1 service nova] Enqueued Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGHEST for action security_group_members [ 858.544500] env[65161]: INFO networking_nsxv3.common.synchronization [req-d7b16645-1004-48c1-b61b-93cca0f51c5c req-85dc8731-1a02-49ed-b9a1-7dca40d40ab1 service nova] Enqueued Resource ID: 203f1d3f-6a4d-44ea-b61e-4a7f20df206b with Priority: HIGHEST for action port [ 858.544709] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGHEST for action security_group_rules [ 858.544836] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGHEST for action security_group_members [ 858.544932] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 203f1d3f-6a4d-44ea-b61e-4a7f20df206b with Priority: HIGHEST for action port [ 858.546012] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31b969f0-436d-400e-8475-a05d3168335c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.546171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.546234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.546505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.546643] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.549489] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-31b969f0-436d-400e-8475-a05d3168335c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.549489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.549489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.549489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.549489] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.549489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.549489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.549489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.549489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.549489] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.549853] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.549853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.549853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.550173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.550173] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('203f1d3f-6a4d-44ea-b61e-4a7f20df206b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.051681] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.056288] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-31b969f0-436d-400e-8475-a05d3168335c taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.056429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.056596] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 203f1d3f-6a4d-44ea-b61e-4a7f20df206b with status ACTIVE [ 859.056777] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.056886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.056961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.057512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.057642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.058037] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.058175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.058274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.058462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.058585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.058867] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.059035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.059131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.059303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.059418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.059526] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 203f1d3f-6a4d-44ea-b61e-4a7f20df206b is going to be updated. [ 859.110455] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.110455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.110455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.110455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.110455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.110455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-203f1d3f-6a4d-44ea-b61e-4a7f20df206b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.392378] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d910b0-5a99-40f2-ba32-49a643c7766c in Status: SUCCESS [ 859.392559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.392685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.393330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.393330] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.393330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.393330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.393939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.393939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.393939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.393939] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.562364] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.623840] env[65161]: INFO networking_nsxv3.common.synchronization [req-f16f7dc9-935e-4800-b3dc-33cdc0ed495f req-11ef5275-af72-45ca-b50a-c1aeb05dbc61 tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 859.623840] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 859.623840] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.623840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.623840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.623840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.623840] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.623840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.623840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.624422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.624422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.624504] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.896195] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.993785] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.994066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.995021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.995021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.995021] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.995021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.995021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.995988] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.995988] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.995988] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.995988] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.996613] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.996613] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.996613] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.996613] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.996613] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.017804] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.017932] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.018156] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.018220] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.018516] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-b11158ab-f61f-418e-8497-aeece376c759 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.018963] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-b11158ab-f61f-418e-8497-aeece376c759" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.019497] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-b11158ab-f61f-418e-8497-aeece376c759" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.019678] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-b11158ab-f61f-418e-8497-aeece376c759" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.019678] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b11158ab-f61f-418e-8497-aeece376c759',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.065485] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.065791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.065791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.066187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.066187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.066187] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31b969f0-436d-400e-8475-a05d3168335c is going to be created. [ 860.094654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.094820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.094870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.095130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.095322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.106742] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31b969f0-436d-400e-8475-a05d3168335c in Status: UNINITIALIZED for 2s [ 860.130317] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.130542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.130620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.130878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.156435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.156435] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.156435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.156435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.156435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.156435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.156435] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 860.185676] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.185872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.185964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.186231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.186444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.197135] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 860.399665] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d910b0-5a99-40f2-ba32-49a643c7766c: rpc.has_security_group_logging(os_id): False [ 860.423754] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.423972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.424115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.424320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.424440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.424740] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.424982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.424982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.425178] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.425283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.425381] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c is going to be created. [ 860.526093] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.526093] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.526093] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.526546] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.526731] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.526913] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port b11158ab-f61f-418e-8497-aeece376c759 not found, creating... [ 860.527342] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.527599] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.527708] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.528054] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.528294] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.528651] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.528858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.529075] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.529386] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.529551] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.529694] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: b11158ab-f61f-418e-8497-aeece376c759 is going to be created. [ 860.543946] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.544157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.544266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.544566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.544995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.558677] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.558952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.559125] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.559580] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.559914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.560234] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-b11158ab-f61f-418e-8497-aeece376c759" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.561899] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d910b0-5a99-40f2-ba32-49a643c7766c in Status: IN_PROGRESS for 2s [ 861.333772] env[65161]: INFO networking_nsxv3.common.synchronization [req-f16f7dc9-935e-4800-b3dc-33cdc0ed495f req-0f3bf3e3-f955-4957-a615-413dff83c022 service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 861.334188] env[65161]: INFO networking_nsxv3.common.synchronization [req-f16f7dc9-935e-4800-b3dc-33cdc0ed495f req-0f3bf3e3-f955-4957-a615-413dff83c022 service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 861.334188] env[65161]: INFO networking_nsxv3.common.synchronization [req-f16f7dc9-935e-4800-b3dc-33cdc0ed495f req-0f3bf3e3-f955-4957-a615-413dff83c022 service nova] Enqueued Resource ID: b11158ab-f61f-418e-8497-aeece376c759 with Priority: HIGHEST for action port [ 861.335261] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 861.335455] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 861.335564] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11158ab-f61f-418e-8497-aeece376c759 with Priority: HIGHEST for action port [ 861.335882] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.336067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.336154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.336435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.336545] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.337867] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.338011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.338409] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b11158ab-f61f-418e-8497-aeece376c759 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.338848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b11158ab-f61f-418e-8497-aeece376c759" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.338848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b11158ab-f61f-418e-8497-aeece376c759" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.338848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b11158ab-f61f-418e-8497-aeece376c759" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.338848] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b11158ab-f61f-418e-8497-aeece376c759',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.841144] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.841734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.845658] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b11158ab-f61f-418e-8497-aeece376c759 with status ACTIVE [ 861.845658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.845658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.845658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.845658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.845658] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b11158ab-f61f-418e-8497-aeece376c759 is going to be updated. [ 861.867381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.867535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.867598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.868540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.868540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.868540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b11158ab-f61f-418e-8497-aeece376c759" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.117513] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31b969f0-436d-400e-8475-a05d3168335c in Status: SUCCESS [ 862.117826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.117993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.118223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.118411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.118582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.118582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.118752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.118819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.118885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.119023] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.207481] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 862.207787] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 862.207840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.208373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.208779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.208861] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.208969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.209050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.209243] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.209312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.209405] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.574492] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d910b0-5a99-40f2-ba32-49a643c7766c in Status: SUCCESS [ 862.574793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.624023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-31b969f0-436d-400e-8475-a05d3168335c taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.624023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.624023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-31b969f0-436d-400e-8475-a05d3168335c taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.624023] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.624023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.625140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.625140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.625140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.625140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.625140] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.695996] env[65161]: INFO networking_nsxv3.common.synchronization [req-9e10870f-15b0-4035-b09a-735e6eafe7c2 req-6a6008cd-2d5b-4fec-ac61-e3b15aff6fb5 tempest-ServersWithSpecificFlavorTestJSON-1681046468 tempest-ServersWithSpecificFlavorTestJSON-1681046468-project-member] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 862.696808] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 862.699019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.699019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.699019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.699019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.699019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.699019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.699019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.699019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.699019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.699019] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.711707] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.806104] env[65161]: INFO networking_nsxv3.common.synchronization [None req-79f1c991-dbbf-44c6-b8ca-b8e0a7b414ba None None] Enqueued Resource ID: af16a0b4-2235-43ef-b07d-5ea4faeb8c9b with Priority: HIGHEST for action port [ 862.807955] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af16a0b4-2235-43ef-b07d-5ea4faeb8c9b with Priority: HIGHEST for action port [ 862.808632] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-af16a0b4-2235-43ef-b07d-5ea4faeb8c9b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.808852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af16a0b4-2235-43ef-b07d-5ea4faeb8c9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.809252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af16a0b4-2235-43ef-b07d-5ea4faeb8c9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.810217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af16a0b4-2235-43ef-b07d-5ea4faeb8c9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.810217] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af16a0b4-2235-43ef-b07d-5ea4faeb8c9b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.128352] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31b969f0-436d-400e-8475-a05d3168335c: rpc.has_security_group_logging(os_id): False [ 863.152221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.152221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.152221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.152221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.152919] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.153295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.153491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.153730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.153992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.155644] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31b969f0-436d-400e-8475-a05d3168335c is going to be created. [ 863.202749] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.202749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.202749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.202749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.202749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.202994] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.203062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.203105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.203316] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.203493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.203493] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 already deleted. [ 863.203595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.214091] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.225012] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.225012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.225012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.225470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.225509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.242860] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31b969f0-436d-400e-8475-a05d3168335c in Status: IN_PROGRESS for 2s [ 863.286905] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.287992] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-634" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.287992] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-634" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.287992] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-634" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.287992] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.288305] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.288305] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.289315] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.289315] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.289415] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.289488] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.289661] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.289865] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.289865] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.290326] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.290326] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.313214] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.313214] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 863.313214] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.313214] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-634" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.313214] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.313214] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.313214] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.313673] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.313717] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61012e24-f2d9-45d7-b4f7-67ec2ec81f89',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.315916] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af16a0b4-2235-43ef-b07d-5ea4faeb8c9b [ 863.315916] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.315916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.315916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.315916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.315916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.315916] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af16a0b4-2235-43ef-b07d-5ea4faeb8c9b already deleted. [ 863.315916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af16a0b4-2235-43ef-b07d-5ea4faeb8c9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.717817] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.717817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.717817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.717817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.717817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.717817] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 863.756035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.756035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.756035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.756035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.756429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.766741] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 863.823193] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.823439] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.823563] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.823847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.824100] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.824171] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 61012e24-f2d9-45d7-b4f7-67ec2ec81f89 not found, creating... [ 863.824441] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.824629] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.824768] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.825027] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.825196] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.825497] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.825650] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.825943] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.828284] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.828481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.828698] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 61012e24-f2d9-45d7-b4f7-67ec2ec81f89 is going to be created. [ 863.857345] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.857565] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.857630] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.857958] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.858350] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.858468] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.570038] env[65161]: INFO networking_nsxv3.common.synchronization [req-9e10870f-15b0-4035-b09a-735e6eafe7c2 req-fdf08f68-0846-4f95-b09e-b961bddfa6ba service nova] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_rules [ 864.570157] env[65161]: INFO networking_nsxv3.common.synchronization [req-9e10870f-15b0-4035-b09a-735e6eafe7c2 req-fdf08f68-0846-4f95-b09e-b961bddfa6ba service nova] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 864.570264] env[65161]: INFO networking_nsxv3.common.synchronization [req-9e10870f-15b0-4035-b09a-735e6eafe7c2 req-fdf08f68-0846-4f95-b09e-b961bddfa6ba service nova] Enqueued Resource ID: 61012e24-f2d9-45d7-b4f7-67ec2ec81f89 with Priority: HIGHEST for action port [ 864.570852] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_rules [ 864.570987] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 864.572373] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61012e24-f2d9-45d7-b4f7-67ec2ec81f89 with Priority: HIGHEST for action port [ 864.572373] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.572373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.572373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.572373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.572373] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.572705] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.572757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.572839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.572949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.573724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.573860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.573978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.574151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.574242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.574337] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.575144] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.575235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.575352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.575441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.576480] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61012e24-f2d9-45d7-b4f7-67ec2ec81f89',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.082058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.082058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.082058] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.082058] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61012e24-f2d9-45d7-b4f7-67ec2ec81f89 with status ACTIVE [ 865.082058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.082058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.082058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.082986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.082986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.083068] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.083551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.083724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.083976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.084102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.084650] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.084812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.085113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.085406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.085514] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.085628] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61012e24-f2d9-45d7-b4f7-67ec2ec81f89 is going to be updated. [ 865.117681] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.117858] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.117907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.118550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.118764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.119104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61012e24-f2d9-45d7-b4f7-67ec2ec81f89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.258355] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31b969f0-436d-400e-8475-a05d3168335c in Status: SUCCESS [ 865.258355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.300794] env[65161]: INFO networking_nsxv3.common.synchronization [req-279de1f4-4037-46ab-818b-0bf575e10786 req-ad44e6b2-8035-40b3-90be-6fef73553525 tempest-ServersNegativeTestJSON-2079955183 tempest-ServersNegativeTestJSON-2079955183-project-member] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 865.301315] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 865.301741] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.302422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.302515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.302893] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.303092] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.303240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.303350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.303586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.304138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.304138] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.588615] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.702848] env[65161]: INFO networking_nsxv3.common.synchronization [None req-605ba429-ab24-48c4-81c4-8809f5ae16ad None None] Enqueued Resource ID: a3729727-41d0-4590-a294-a55c2f7b1803 with Priority: HIGHEST for action port [ 865.703512] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3729727-41d0-4590-a294-a55c2f7b1803 with Priority: HIGHEST for action port [ 865.703848] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3729727-41d0-4590-a294-a55c2f7b1803 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.704023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3729727-41d0-4590-a294-a55c2f7b1803" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.704792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3729727-41d0-4590-a294-a55c2f7b1803" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.705011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3729727-41d0-4590-a294-a55c2f7b1803" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.705142] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3729727-41d0-4590-a294-a55c2f7b1803',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.781977] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 865.781977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.781977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.781977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.781977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.781977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.781977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.781977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.781977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.781977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.781977] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.808588] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.808588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.808588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.808588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.808588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.808588] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.809155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.810212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.810212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.810212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.810212] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e3e485-b210-4594-a46e-85922cc804cf already deleted. [ 865.810212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.885173] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.885377] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.885500] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.885826] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.890359] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.890359] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.890359] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.890359] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.890359] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.890359] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.890359] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.890359] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.890359] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.890359] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.890359] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.890359] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.910547] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.910547] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.910968] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.911235] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.912865] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.912865] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.913257] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.913371] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.913509] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.091450] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.092010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.092151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.092441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.092939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.093095] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 is going to be created. [ 866.128390] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.128720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.128720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.128831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.129168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.151667] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: UNINITIALIZED for 2s [ 866.206963] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3729727-41d0-4590-a294-a55c2f7b1803 [ 866.207250] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.207406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.207479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.207725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.207821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.207936] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3729727-41d0-4590-a294-a55c2f7b1803 already deleted. [ 866.208034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3729727-41d0-4590-a294-a55c2f7b1803" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.235286] env[65161]: INFO networking_nsxv3.common.synchronization [None req-2525a551-3ee0-4f00-8a07-b7f926d0c757 None None] Enqueued Resource ID: 5f00ea50-dcb6-4d1f-a533-765f2f8213f3 with Priority: HIGHEST for action port [ 866.235863] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f00ea50-dcb6-4d1f-a533-765f2f8213f3 with Priority: HIGHEST for action port [ 866.237530] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f00ea50-dcb6-4d1f-a533-765f2f8213f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.237530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f00ea50-dcb6-4d1f-a533-765f2f8213f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.237530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f00ea50-dcb6-4d1f-a533-765f2f8213f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.237530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f00ea50-dcb6-4d1f-a533-765f2f8213f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.237530] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f00ea50-dcb6-4d1f-a533-765f2f8213f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.284730] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.284928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.284983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.285306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.285380] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.287446] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.287446] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.287446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.287446] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.421022] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.421022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.421022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.421022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.421022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.421022] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 not found, creating... [ 866.421022] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.421022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.421022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.421681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.421681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.421681] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.421814] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.421890] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.423049] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.423261] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.423419] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 is going to be created. [ 866.445506] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.445506] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.445506] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.445506] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.445807] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.445885] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.739778] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f00ea50-dcb6-4d1f-a533-765f2f8213f3 [ 866.740015] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.740167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.740252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.740467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.740553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.740646] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f00ea50-dcb6-4d1f-a533-765f2f8213f3 already deleted. [ 866.740729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f00ea50-dcb6-4d1f-a533-765f2f8213f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.788804] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 490d862d-f7b2-497d-912a-e1801d9b16ad: rpc.has_security_group_logging(os_id): False [ 866.810054] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.810298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.810298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.810931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.810931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.811077] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.811138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.811174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.811393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.811675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.811772] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.811882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.811961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.812452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.812615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.812883] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.813025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.813113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.813305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.813549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.813549] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 866.880600] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.880797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.880797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.881484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.881484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.894205] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 867.205643] env[65161]: INFO networking_nsxv3.common.synchronization [req-279de1f4-4037-46ab-818b-0bf575e10786 req-f99617a0-1ed5-4d7e-891c-16c2daf7716f service nova] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_rules [ 867.205965] env[65161]: INFO networking_nsxv3.common.synchronization [req-279de1f4-4037-46ab-818b-0bf575e10786 req-f99617a0-1ed5-4d7e-891c-16c2daf7716f service nova] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 867.205965] env[65161]: INFO networking_nsxv3.common.synchronization [req-279de1f4-4037-46ab-818b-0bf575e10786 req-f99617a0-1ed5-4d7e-891c-16c2daf7716f service nova] Enqueued Resource ID: dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 with Priority: HIGHEST for action port [ 867.206613] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_rules [ 867.206726] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 867.206848] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 with Priority: HIGHEST for action port [ 867.207424] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.207572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.207653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.207952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.208059] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.209567] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.209746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.209920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.210413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.210587] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.210695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.210786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.211526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.211526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.211526] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.214500] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.214500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.214500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.214500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.214500] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.715619] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.715796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.715896] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.716811] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 with status ACTIVE [ 867.717028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.717128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.717204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.719130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.720036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.720036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.720036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.720036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.720036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.720036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.720036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.720677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.720677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.720677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.720677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.720677] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 is going to be updated. [ 867.749511] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.751623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.751623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.751623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.751623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.751623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.150343] env[65161]: INFO networking_nsxv3.common.synchronization [req-bcbd536d-a4da-4ddd-b068-cf630985b28d req-5133a1d4-f406-40a3-9026-e73683e12302 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 868.150343] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 868.150815] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.151127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.151357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.152341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.155016] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.155016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.155016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.155016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.155016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.155016] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.168529] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: SUCCESS [ 868.170727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.170727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.170727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.170727] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.170727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.170727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.170727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.170727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.170727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.170727] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.222661] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.399323] env[65161]: INFO networking_nsxv3.common.synchronization [None req-9e2f0c79-3b5b-49ff-9e58-b50ac7860149 None None] Enqueued Resource ID: 79de9c3f-08af-49bf-89bf-d87c42cfe558 with Priority: HIGHEST for action port [ 868.399974] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79de9c3f-08af-49bf-89bf-d87c42cfe558 with Priority: HIGHEST for action port [ 868.400379] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-79de9c3f-08af-49bf-89bf-d87c42cfe558 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.400509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79de9c3f-08af-49bf-89bf-d87c42cfe558" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.400599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79de9c3f-08af-49bf-89bf-d87c42cfe558" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.400873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79de9c3f-08af-49bf-89bf-d87c42cfe558" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.400921] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79de9c3f-08af-49bf-89bf-d87c42cfe558',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.659033] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.659033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.659253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.659495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.659583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.659828] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.660101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.660354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.661433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.661433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.661433] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be deleted. [ 868.674395] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.695228] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.695408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.696125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.696125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.696125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.696125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.728850] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.728975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.729056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.729269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.729359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.729454] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be created. [ 868.770678] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.770814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.770909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.771162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.771331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.783827] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: UNINITIALIZED for 2s [ 868.904621] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79de9c3f-08af-49bf-89bf-d87c42cfe558 [ 868.904886] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.905043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.905114] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.908476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.908583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.913034] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79de9c3f-08af-49bf-89bf-d87c42cfe558 already deleted. [ 868.913034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79de9c3f-08af-49bf-89bf-d87c42cfe558" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.913034] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 868.913034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.920389] env[65161]: INFO networking_nsxv3.common.synchronization [req-bcbd536d-a4da-4ddd-b068-cf630985b28d req-7200fffb-a516-41de-a5b5-3a2fda8e6e6a tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 868.920666] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 868.923987] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.923987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.923987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.923987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.923987] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.923987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.923987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.923987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.923987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.923987] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.177725] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39: rpc.has_security_group_logging(os_id): False [ 869.200609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.200902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.200902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.202047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.202047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.202047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.202047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.202047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.202047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.202047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.202047] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 is going to be created. [ 869.278162] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.278444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.278444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.278784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.279436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.291522] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: IN_PROGRESS for 2s [ 869.426795] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.426961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.427051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.427274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.427369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.427700] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.427700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.427700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.428082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.428082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.428082] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe already deleted. [ 869.428265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.445512] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-589 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.445512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-589" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.445512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-589" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.445512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-589" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.445512] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.445512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.445512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.446251] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.446251] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.446251] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.446442] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.446442] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.446581] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.446651] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.446838] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.446943] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.481686] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.481686] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.481686] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.481858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-589" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.482194] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-a94983e2-9b17-484e-ac1a-24ebd84e9b21 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.482399] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-a94983e2-9b17-484e-ac1a-24ebd84e9b21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.482521] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-a94983e2-9b17-484e-ac1a-24ebd84e9b21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.482853] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-a94983e2-9b17-484e-ac1a-24ebd84e9b21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.482995] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a94983e2-9b17-484e-ac1a-24ebd84e9b21',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.989201] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.989417] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.989546] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.990078] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.990325] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.990520] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port a94983e2-9b17-484e-ac1a-24ebd84e9b21 not found, creating... [ 869.990844] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.991053] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.991267] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.991462] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.991982] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.992396] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.992642] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.992765] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.993016] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.993191] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.993396] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: a94983e2-9b17-484e-ac1a-24ebd84e9b21 is going to be created. [ 870.014124] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.014677] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.014823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.015142] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.015401] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.016266] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-a94983e2-9b17-484e-ac1a-24ebd84e9b21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.755120] env[65161]: INFO networking_nsxv3.common.synchronization [req-bcbd536d-a4da-4ddd-b068-cf630985b28d req-94da385b-ebe6-4fda-832b-84d0d26c9d1f service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 870.755120] env[65161]: INFO networking_nsxv3.common.synchronization [req-bcbd536d-a4da-4ddd-b068-cf630985b28d req-94da385b-ebe6-4fda-832b-84d0d26c9d1f service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 870.755120] env[65161]: INFO networking_nsxv3.common.synchronization [req-bcbd536d-a4da-4ddd-b068-cf630985b28d req-94da385b-ebe6-4fda-832b-84d0d26c9d1f service nova] Enqueued Resource ID: a94983e2-9b17-484e-ac1a-24ebd84e9b21 with Priority: HIGHEST for action port [ 870.755120] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 870.756035] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 870.756167] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a94983e2-9b17-484e-ac1a-24ebd84e9b21 with Priority: HIGHEST for action port [ 870.756854] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.756995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.757077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.757289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.757482] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.758325] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.758878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.758933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.759135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.759295] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.759397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.759469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.759601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.759686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.759775] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.765341] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a94983e2-9b17-484e-ac1a-24ebd84e9b21 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.765555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a94983e2-9b17-484e-ac1a-24ebd84e9b21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.765555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a94983e2-9b17-484e-ac1a-24ebd84e9b21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.765790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a94983e2-9b17-484e-ac1a-24ebd84e9b21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.765879] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a94983e2-9b17-484e-ac1a-24ebd84e9b21',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.795851] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 870.796160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.796938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.797245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.798859] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.799084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.799236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.799607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.799825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.799961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.800127] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.269540] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.269540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.269540] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.270509] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a94983e2-9b17-484e-ac1a-24ebd84e9b21 with status ACTIVE [ 871.270753] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.270907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.271009] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.271255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.271386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.272418] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.272418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.272418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.272418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.272418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.272418] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.272747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.272866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.273517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.273650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.273768] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a94983e2-9b17-484e-ac1a-24ebd84e9b21 is going to be updated. [ 871.297121] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.297121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.297378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.297421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.297548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.297744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a94983e2-9b17-484e-ac1a-24ebd84e9b21" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.304785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.305150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.305150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.305324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.305516] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.305621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.305729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.305838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.306327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.306327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.306327] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.306327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.306327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.306529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.306582] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.306682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.306732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.306833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.306904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.306988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.307103] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.308784] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: SUCCESS [ 871.308992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.653787] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.654056] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-524" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.654145] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-524" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.654491] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-524" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.654884] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.655026] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.655223] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.655516] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.655668] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.656709] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.656709] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.656709] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.656709] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.656709] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.656709] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.656709] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.681683] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.681945] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.682038] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.682491] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-524" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.682847] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.683040] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.683164] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.683566] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.683722] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e97c8da1-35f5-4e47-b8c2-475f1df4d03d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.776445] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.811357] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3e3e485-b210-4594-a46e-85922cc804cf: rpc.has_security_group_logging(os_id): False [ 871.829886] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.830079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.830140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.830346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.830443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.830629] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.830728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.830789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.830932] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.831013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.831211] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.831304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.831364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.831494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.831567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.831737] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.831827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.831883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.833615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.833761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.833855] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be created. [ 871.897654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.897853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.897933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.898194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.898422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.914049] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 2s [ 872.186761] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.188513] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.188513] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.188513] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.188513] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.188513] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port e97c8da1-35f5-4e47-b8c2-475f1df4d03d not found, creating... [ 872.188513] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.188513] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.188513] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.188513] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.188513] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.189052] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.189052] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.189052] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.189331] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.189395] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.189611] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: e97c8da1-35f5-4e47-b8c2-475f1df4d03d is going to be created. [ 872.210797] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.211625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.211625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.211795] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.211881] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.213055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.279379] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.279544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.279665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.279861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.279907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.282302] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be created. [ 872.332126] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.332399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.332509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.332746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.332947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.343579] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: UNINITIALIZED for 2s [ 872.914986] env[65161]: INFO networking_nsxv3.common.synchronization [req-bcbd536d-a4da-4ddd-b068-cf630985b28d req-e28c5388-af3a-45bf-b533-faafb2edbec8 service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 872.915247] env[65161]: INFO networking_nsxv3.common.synchronization [req-bcbd536d-a4da-4ddd-b068-cf630985b28d req-e28c5388-af3a-45bf-b533-faafb2edbec8 service nova] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 872.915247] env[65161]: INFO networking_nsxv3.common.synchronization [req-bcbd536d-a4da-4ddd-b068-cf630985b28d req-e28c5388-af3a-45bf-b533-faafb2edbec8 service nova] Enqueued Resource ID: e97c8da1-35f5-4e47-b8c2-475f1df4d03d with Priority: HIGHEST for action port [ 872.915742] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_rules [ 872.915875] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 872.915972] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97c8da1-35f5-4e47-b8c2-475f1df4d03d with Priority: HIGHEST for action port [ 872.916289] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.916486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.916709] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.916848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.916973] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.917095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.917156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.917456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.917562] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e97c8da1-35f5-4e47-b8c2-475f1df4d03d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.419233] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e97c8da1-35f5-4e47-b8c2-475f1df4d03d with status ACTIVE [ 873.420064] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.420064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.420064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.420250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.420368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.420615] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.420772] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.420878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.421116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.421229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.421497] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.424115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.424210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.424379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.424465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.424554] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e97c8da1-35f5-4e47-b8c2-475f1df4d03d is going to be updated. [ 873.451179] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.451179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.451179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.451179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.451179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.451179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e97c8da1-35f5-4e47-b8c2-475f1df4d03d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.927053] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 873.927395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.354229] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 874.354396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.354558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.354765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.354964] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.357079] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.357079] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.357079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.357685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.359506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.359506] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.862210] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.862498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.863108] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.368636] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.871823] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.873158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.873158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.873158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.873158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.873158] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 875.907143] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.907143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.907143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.907143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.907143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.920013] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 876.404731] env[65161]: INFO networking_nsxv3.common.synchronization [req-9b6b8e47-21f3-4674-9c26-60cba6104f83 req-645b3f79-a839-445a-bd72-fbdf400671b1 tempest-ServerMetadataNegativeTestJSON-1238484076 tempest-ServerMetadataNegativeTestJSON-1238484076-project-member] Enqueued Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGHEST for action security_group_members [ 876.405749] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGHEST for action security_group_members [ 876.406190] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-31b969f0-436d-400e-8475-a05d3168335c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.406353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.406448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.406718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.406934] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.407306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.407306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.407419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.407541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.407672] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.911263] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.911263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.911263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.911263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.911263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.911540] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.911540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.911621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.911721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.911815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.911857] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31b969f0-436d-400e-8475-a05d3168335c is going to be updated. [ 876.944407] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.944566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.944648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.944830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.944972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.955227] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31b969f0-436d-400e-8475-a05d3168335c in Status: IN_PROGRESS for 2s [ 877.930792] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 877.931200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.933417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.933417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.933417] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.933417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.933417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.933417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.933417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.933417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.933417] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.933780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.933780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.933919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.934193] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.934354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.934426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.934602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.934713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.934793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.934953] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.437812] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37b81f40-c340-4f5d-8250-ce4f8efa78fe: rpc.has_security_group_logging(os_id): False [ 878.455663] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.455753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.455829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.456082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.459819] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.459819] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.459819] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.459819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.460576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.460576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.460576] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be created. [ 878.526169] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.526310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.526438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.526703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.527010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.542616] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 878.910530] env[65161]: INFO networking_nsxv3.common.synchronization [req-49c23ab4-fa35-41bc-8537-da9db3218be3 req-d78d5c29-8059-45b7-b026-a414963b07b7 tempest-ServersAdminTestJSON-2133010713 tempest-ServersAdminTestJSON-2133010713-project-member] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 878.910747] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 878.911190] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.912081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.912081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.912081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.912300] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.912300] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.912424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.912630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.912764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.912870] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.972027] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31b969f0-436d-400e-8475-a05d3168335c in Status: SUCCESS [ 878.972027] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31b969f0-436d-400e-8475-a05d3168335c deletion is rescheduled due to dependency. [ 878.972027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.417383] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.920305] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.423603] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.423867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.423867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.423924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.424020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.424157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 880.467865] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.467942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.468020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.468195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.468460] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.479167] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 880.560782] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 880.560782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.560782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.560782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.560782] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.670173] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1fe190e-1b4c-4b9a-9ade-d96b568162a7 req-e895b995-83d4-43a2-a382-0c60d41ba88f tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 880.670173] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 880.670173] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.670173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.670173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.670173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.670173] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.670173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.670173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.670173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.670173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.670173] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.018722] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.019259] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.019542] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.019892] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.020299] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.020544] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.020726] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.021055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.021320] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.021606] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.021791] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.022307] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.022521] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.022736] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.022917] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.023162] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.047043] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.047215] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.047529] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.047529] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.047884] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.048203] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.048522] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.048998] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.049408] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a689bf99-b3eb-4cd8-8e92-253bbbe96ab1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.065422] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.066175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.066377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.067356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.067630] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.067843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.067971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.068221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.068368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.068528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.068669] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.171988] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.552947] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.553377] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.553377] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.554418] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.554418] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.554418] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port a689bf99-b3eb-4cd8-8e92-253bbbe96ab1 not found, creating... [ 881.554418] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.554418] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.554676] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.554828] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.554924] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.555741] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.555741] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.555741] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.555741] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.555931] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.555985] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: a689bf99-b3eb-4cd8-8e92-253bbbe96ab1 is going to be created. [ 881.573113] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.573285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.573377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.573585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.573743] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.576806] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.576806] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.576806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.576806] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.580970] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.581188] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.581452] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.581537] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.581755] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.581975] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.674473] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.977662] env[65161]: INFO networking_nsxv3.common.synchronization [req-d49ec19d-db89-4cc7-a6b5-f9cd26415154 req-dcbc17ce-76f0-4a80-91de-be0b5cb79479 tempest-ListServerFiltersTestJSON-655968173 tempest-ListServerFiltersTestJSON-655968173-project-member] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 881.978212] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 881.978637] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.978748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.978748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.978945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.979230] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.979346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.979412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.979570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.979647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.979740] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.081165] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37b81f40-c340-4f5d-8250-ce4f8efa78fe: rpc.has_security_group_logging(os_id): False [ 882.100527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.100716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.100792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.100989] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.101096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.101304] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.101431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.101508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.101680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.101762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.101961] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.102059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.102122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.102308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.102418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.102642] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.103367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.103367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.103367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.103367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.103367] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 882.162039] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.162196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.162306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.162553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.162701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.176602] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.176756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.176833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.177056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.177219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.177254] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 882.179215] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 882.234917] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.234917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.234917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.234917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.234917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.260484] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 882.301887] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1fe190e-1b4c-4b9a-9ade-d96b568162a7 req-5aa15792-436c-4e4c-81ae-b20c404d99c2 service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 882.302378] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1fe190e-1b4c-4b9a-9ade-d96b568162a7 req-5aa15792-436c-4e4c-81ae-b20c404d99c2 service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 882.302506] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1fe190e-1b4c-4b9a-9ade-d96b568162a7 req-5aa15792-436c-4e4c-81ae-b20c404d99c2 service nova] Enqueued Resource ID: a689bf99-b3eb-4cd8-8e92-253bbbe96ab1 with Priority: HIGHEST for action port [ 882.304034] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 882.304034] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 882.304034] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a689bf99-b3eb-4cd8-8e92-253bbbe96ab1 with Priority: HIGHEST for action port [ 882.304034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.304034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.304034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.304422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.304422] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.305311] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.305311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.305881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.306031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.306068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.307129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.307129] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a689bf99-b3eb-4cd8-8e92-253bbbe96ab1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.481919] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.504199] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 882.504432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.808158] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.808447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.809590] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a689bf99-b3eb-4cd8-8e92-253bbbe96ab1 with status ACTIVE [ 882.809766] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.809879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.809944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.810825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.810927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.811134] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.811243] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.811308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.811590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.811679] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.811872] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.812046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.812046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.812184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.812258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.812370] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a689bf99-b3eb-4cd8-8e92-253bbbe96ab1 is going to be updated. [ 882.831805] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.831967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.831967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.832133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.832294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.832483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a689bf99-b3eb-4cd8-8e92-253bbbe96ab1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.984353] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.487269] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.487428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.487501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.487708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.487795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.487897] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 883.534047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.534361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.534361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.534361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.534528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.545172] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 884.194242] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 884.194525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.271927] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 884.272307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.272626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.274555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.274555] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.274555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.274555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.274555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.274555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.274555] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.775928] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.279484] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.558599] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 885.558848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.782617] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.782795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.782876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.783127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.783245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.783424] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 885.815915] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.816093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.816169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.816395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.816559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.828030] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 886.612444] env[65161]: INFO networking_nsxv3.common.synchronization [req-9d6dc12a-ecb5-4bb0-83a9-adc15a9f4291 req-693d1e3a-827e-4e15-9bfd-2cd0b8224db6 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 886.612444] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 886.612444] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.612954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.613158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.613528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.613813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.614658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.614744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.614901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.614991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.615104] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.918136] env[65161]: INFO networking_nsxv3.common.synchronization [req-9d6dc12a-ecb5-4bb0-83a9-adc15a9f4291 req-a823a4ee-0cec-4590-a86b-6356514d0e87 tempest-ServersTestMultiNic-1314344379 tempest-ServersTestMultiNic-1314344379-project-member] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 886.918136] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGHEST for action security_group_members [ 886.918209] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.918302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.117805] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.621458] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.840042] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 887.840326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.840455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.840707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.840881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.841008] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.841085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.841236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.841317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.841402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.841492] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.124896] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.124896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.124896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.124896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.124896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.124896] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 888.157241] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.157479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.157554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.158469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.158469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.167757] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 888.180882] env[65161]: INFO networking_nsxv3.common.synchronization [None req-d4251ffd-bb33-483a-9004-aaf8680ee36c None None] Enqueued Resource ID: d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d with Priority: HIGHEST for action port [ 888.181767] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d with Priority: HIGHEST for action port [ 888.182124] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.182250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.182389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.182623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.182712] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.343948] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.344524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.345326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.345614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.345857] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.345979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.346024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.346418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.346418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.346418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.346541] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.346700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.346700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.346816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.347015] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.347164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.347164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.347327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.347376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.347431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.347524] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.687239] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d [ 888.687239] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.687239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.687239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.687239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.687239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.687239] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d already deleted. [ 888.687239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4a6b7f3-a87f-4aca-b1f2-4c2e16dc115d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.850714] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68ff1a7f-59cd-4081-9af0-9322734ba92b: rpc.has_security_group_logging(os_id): False [ 888.872372] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.872372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.872480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.873209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.894358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.894640] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.894766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.894833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.895047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.895129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.895336] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.895436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.895595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.895698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.895752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.895923] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.896022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.897503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.897503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.897503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.897503] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 888.977278] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.977385] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.977446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.977645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.977803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.998130] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 890.180380] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 890.180380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.180380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.180380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.180742] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.180742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.180742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.180848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.180922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.181025] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.219018] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7c4c3c11-6b50-45b3-aad1-b6e3b652b8cf tempest-MigrationsAdminTest-2053071831 tempest-MigrationsAdminTest-2053071831-project-member] Enqueued Resource ID: f0ed71e6-ecc1-43fd-85e6-b8630f978e52 with Priority: HIGHEST for action security_group_rules [ 890.219851] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0ed71e6-ecc1-43fd-85e6-b8630f978e52 with Priority: HIGHEST for action security_group_rules [ 890.220609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.220793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.220896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.221213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.221340] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0ed71e6-ecc1-43fd-85e6-b8630f978e52',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.315042] env[65161]: INFO networking_nsxv3.common.synchronization [None req-6d19bb8a-f67d-45b2-86c5-dd19562f374e tempest-MigrationsAdminTest-2053071831 tempest-MigrationsAdminTest-2053071831-project-member] Enqueued Resource ID: f0ed71e6-ecc1-43fd-85e6-b8630f978e52 with Priority: HIGHEST for action security_group_rules [ 890.315889] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0ed71e6-ecc1-43fd-85e6-b8630f978e52 with Priority: HIGHEST for action security_group_rules [ 890.318970] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.320875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.528416] env[65161]: INFO networking_nsxv3.common.synchronization [None req-cc014dc6-163d-4998-a9c3-74d1f8166580 None None] Enqueued Resource ID: 405ae98a-fc7f-421e-a44e-f07d2796f426 with Priority: HIGHEST for action port [ 890.529045] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 405ae98a-fc7f-421e-a44e-f07d2796f426 with Priority: HIGHEST for action port [ 890.529401] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-405ae98a-fc7f-421e-a44e-f07d2796f426 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.529846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-405ae98a-fc7f-421e-a44e-f07d2796f426" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.529920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-405ae98a-fc7f-421e-a44e-f07d2796f426" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.530193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-405ae98a-fc7f-421e-a44e-f07d2796f426" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.530284] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('405ae98a-fc7f-421e-a44e-f07d2796f426',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.683340] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.683534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.683609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.683833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.683926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.684149] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.684242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.684325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.684467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.684569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.684660] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be updated. [ 890.716935] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.719825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.719825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.719825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.719825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.728715] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: IN_PROGRESS for 2s [ 890.747167] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.747167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.747167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.747167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.747167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.747167] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0ed71e6-ecc1-43fd-85e6-b8630f978e52 already deleted. [ 890.747167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.747167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.747167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.747167] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0ed71e6-ecc1-43fd-85e6-b8630f978e52',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.010581] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 891.010807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.035988] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 405ae98a-fc7f-421e-a44e-f07d2796f426 [ 891.036436] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.036577] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.038294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.038294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.038294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.038294] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:405ae98a-fc7f-421e-a44e-f07d2796f426 already deleted. [ 891.038294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-405ae98a-fc7f-421e-a44e-f07d2796f426" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.276895] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.277177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.277217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.277444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.277555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.277787] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0ed71e6-ecc1-43fd-85e6-b8630f978e52 already deleted. [ 891.278073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0ed71e6-ecc1-43fd-85e6-b8630f978e52" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.255851] env[65161]: INFO networking_nsxv3.common.synchronization [req-fbe3007b-8ab7-459c-8cd4-8ac38f4378e7 req-731c64a5-ea27-46b6-aa96-27f8898982ce tempest-ServersTestFqdnHostnames-1875275343 tempest-ServersTestFqdnHostnames-1875275343-project-member] Enqueued Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_members [ 892.256533] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_members [ 892.256839] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38cb053-aec9-4ead-86a8-4aa3f2154903 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.256970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.257047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.257318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.257531] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.257648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.257712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.257875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.257960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.258069] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.620509] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.620841] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.620890] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.621331] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.621720] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.621921] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.622170] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.622369] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.622562] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.622747] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.622860] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.622965] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.623082] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.623222] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.623328] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.623421] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.644873] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.645149] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.645274] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.645512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.645817] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-f591ad19-1e27-4d76-885d-30b147854c8f taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.646025] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-f591ad19-1e27-4d76-885d-30b147854c8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.646180] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-f591ad19-1e27-4d76-885d-30b147854c8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.646568] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-f591ad19-1e27-4d76-885d-30b147854c8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.646724] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f591ad19-1e27-4d76-885d-30b147854c8f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.667065] env[65161]: INFO networking_nsxv3.common.synchronization [req-d4901c1e-8211-47bc-8c9c-5af06a9c26e5 req-28b1158f-7954-49b6-a5c3-13f68bf2fba8 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 892.667562] env[65161]: INFO networking_nsxv3.common.synchronization [req-d4901c1e-8211-47bc-8c9c-5af06a9c26e5 req-28b1158f-7954-49b6-a5c3-13f68bf2fba8 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 892.667761] env[65161]: INFO networking_nsxv3.common.synchronization [req-d4901c1e-8211-47bc-8c9c-5af06a9c26e5 req-28b1158f-7954-49b6-a5c3-13f68bf2fba8 tempest-SecurityGroupsTestJSON-666909381 tempest-SecurityGroupsTestJSON-666909381-project-member] Enqueued Resource ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 with Priority: HIGHEST for action security_group_members [ 892.668726] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGHEST for action security_group_members [ 892.668896] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGHEST for action security_group_members [ 892.669048] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 with Priority: HIGHEST for action security_group_members [ 892.670078] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.670366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.670486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.670738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.670932] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.671078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.671166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.671339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.671451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.671668] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.672654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.672761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.672864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.673039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.673220] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.673348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.673414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.673597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.673699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.673812] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.675232] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-b59bd654-2015-4855-bb01-60ad0a84a0b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.675344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.675411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.675565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.675709] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.675804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.675866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.676011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.676194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.676290] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b59bd654-2015-4855-bb01-60ad0a84a0b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.744855] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe in Status: SUCCESS [ 892.744855] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe deletion is rescheduled due to dependency. [ 892.744855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.762514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.762688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.762756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.762983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.763087] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.763295] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.763761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.763761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.763761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.763761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.763955] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 already deleted. [ 892.763955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.149854] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.149854] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.149854] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.149854] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.149854] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.150165] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port f591ad19-1e27-4d76-885d-30b147854c8f not found, creating... [ 893.150705] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.151084] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.151347] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.151704] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.151776] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.152994] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.152994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.152994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.152994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.152994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.152994] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: f591ad19-1e27-4d76-885d-30b147854c8f is going to be created. [ 893.176255] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.176469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.176745] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.177093] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.177374] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.177664] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-f591ad19-1e27-4d76-885d-30b147854c8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.178749] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.178838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.179091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.179224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.180560] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.180674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.181201] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.181342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.206141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.206908] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.207194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.207307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.207623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.207747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.207855] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be updated. [ 893.209319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.209579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.238069] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.238409] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.238876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.238876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.238876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.238997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.239044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 is going to be updated. [ 893.240095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.240370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.240489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.241053] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.241053] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.241053] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.241233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.241233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.241309] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be updated. [ 893.284809] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.285019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.285019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.285246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.285416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.302436] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: IN_PROGRESS for 2s [ 893.342966] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.343188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.343279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.343575] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.343768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.346934] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.346934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.346934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.346934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.346934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.361183] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 in Status: IN_PROGRESS for 2s [ 893.361598] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: IN_PROGRESS for 2s [ 893.912268] env[65161]: INFO networking_nsxv3.common.synchronization [req-fbe3007b-8ab7-459c-8cd4-8ac38f4378e7 req-db8a9fe4-f56a-478b-b0e0-678bfd4c0529 service nova] Enqueued Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_rules [ 893.912592] env[65161]: INFO networking_nsxv3.common.synchronization [req-fbe3007b-8ab7-459c-8cd4-8ac38f4378e7 req-db8a9fe4-f56a-478b-b0e0-678bfd4c0529 service nova] Enqueued Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_members [ 893.912592] env[65161]: INFO networking_nsxv3.common.synchronization [req-fbe3007b-8ab7-459c-8cd4-8ac38f4378e7 req-db8a9fe4-f56a-478b-b0e0-678bfd4c0529 service nova] Enqueued Resource ID: f591ad19-1e27-4d76-885d-30b147854c8f with Priority: HIGHEST for action port [ 893.913131] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_rules [ 893.913266] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_members [ 893.913388] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f591ad19-1e27-4d76-885d-30b147854c8f with Priority: HIGHEST for action port [ 893.913718] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c38cb053-aec9-4ead-86a8-4aa3f2154903 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.913785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.913818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.913991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.914095] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.914963] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38cb053-aec9-4ead-86a8-4aa3f2154903 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.915099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.915167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.915404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.915552] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.915684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.915723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.915883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.915969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.915997] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.917314] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f591ad19-1e27-4d76-885d-30b147854c8f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.917430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f591ad19-1e27-4d76-885d-30b147854c8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.917500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f591ad19-1e27-4d76-885d-30b147854c8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.917651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f591ad19-1e27-4d76-885d-30b147854c8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.917723] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f591ad19-1e27-4d76-885d-30b147854c8f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.420082] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38cb053-aec9-4ead-86a8-4aa3f2154903 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.420255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.420420] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.421376] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f591ad19-1e27-4d76-885d-30b147854c8f with status ACTIVE [ 894.421625] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.421742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.421815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.422062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.422224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.422427] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.422540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.422694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.422934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.422934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.423105] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.423288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.423346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.423575] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.423694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.423818] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f591ad19-1e27-4d76-885d-30b147854c8f is going to be updated. [ 894.454494] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.455203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.455203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.455339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.455572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.455751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f591ad19-1e27-4d76-885d-30b147854c8f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.843603] env[65161]: INFO networking_nsxv3.common.synchronization [req-942a0c4c-fca5-4251-bfee-68a35e055706 req-d86377cf-3527-4327-90fa-3606b906f61e tempest-ServersTestJSON-592902756 tempest-ServersTestJSON-592902756-project-member] Enqueued Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_members [ 894.844250] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_members [ 894.844482] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-70c8e546-9b00-4441-97c1-cb8beb5cab1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.844606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.844669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.845149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.846798] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.846929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.846997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.847179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.847267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.847373] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.926665] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.182993] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.183216] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-392" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.183342] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-392" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.185381] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-392" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.185761] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.185969] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.186131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.186450] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.186626] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.186882] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.187019] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.187146] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.187291] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.187511] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.187579] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.187722] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.210103] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.210103] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.210103] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.210103] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-392" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.210372] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-1239a97f-168b-4b62-8d1a-038b37395070 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.210581] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-1239a97f-168b-4b62-8d1a-038b37395070" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.210697] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-1239a97f-168b-4b62-8d1a-038b37395070" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.211040] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-1239a97f-168b-4b62-8d1a-038b37395070" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.211181] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1239a97f-168b-4b62-8d1a-038b37395070',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.314125] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 in Status: SUCCESS [ 895.314692] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 deletion is rescheduled due to dependency. [ 895.314692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.351564] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.351564] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.351564] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f already deleted. [ 895.351564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.371898] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 in Status: SUCCESS [ 895.372248] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b59bd654-2015-4855-bb01-60ad0a84a0b0 deletion is rescheduled due to dependency. [ 895.372522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b59bd654-2015-4855-bb01-60ad0a84a0b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.376391] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd in Status: SUCCESS [ 895.376583] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd deletion is rescheduled due to dependency. [ 895.376704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.429909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.429909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.430081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.431484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.431484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.431484] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 is going to be created. [ 895.457905] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.457905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.457905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.457905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.457905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.473047] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 in Status: UNINITIALIZED for 2s [ 895.717157] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.717417] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.717575] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.717863] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.718073] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.718254] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 1239a97f-168b-4b62-8d1a-038b37395070 not found, creating... [ 895.718580] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.718762] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.718889] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.719174] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.719321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.719617] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.719776] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.719900] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.720152] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.720288] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.720482] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 1239a97f-168b-4b62-8d1a-038b37395070 is going to be created. [ 895.744796] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.744796] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.744796] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.745316] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.745316] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.745422] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-1239a97f-168b-4b62-8d1a-038b37395070" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.560452] env[65161]: INFO networking_nsxv3.common.synchronization [req-942a0c4c-fca5-4251-bfee-68a35e055706 req-0da74cfd-16c5-46b9-86c2-513512e7d5be service nova] Enqueued Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_rules [ 896.560759] env[65161]: INFO networking_nsxv3.common.synchronization [req-942a0c4c-fca5-4251-bfee-68a35e055706 req-0da74cfd-16c5-46b9-86c2-513512e7d5be service nova] Enqueued Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_members [ 896.560759] env[65161]: INFO networking_nsxv3.common.synchronization [req-942a0c4c-fca5-4251-bfee-68a35e055706 req-0da74cfd-16c5-46b9-86c2-513512e7d5be service nova] Enqueued Resource ID: 1239a97f-168b-4b62-8d1a-038b37395070 with Priority: HIGHEST for action port [ 896.561495] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_rules [ 896.561635] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_members [ 896.561732] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1239a97f-168b-4b62-8d1a-038b37395070 with Priority: HIGHEST for action port [ 896.562016] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.562150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.562218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.562450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.562533] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.563482] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-70c8e546-9b00-4441-97c1-cb8beb5cab1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.563598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.563664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.563845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.563993] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.564105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.564167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.564305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.564390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.564513] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.565348] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-1239a97f-168b-4b62-8d1a-038b37395070 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.565523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1239a97f-168b-4b62-8d1a-038b37395070" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.565523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1239a97f-168b-4b62-8d1a-038b37395070" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.565602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1239a97f-168b-4b62-8d1a-038b37395070" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.565650] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1239a97f-168b-4b62-8d1a-038b37395070',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.067508] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.069170] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-70c8e546-9b00-4441-97c1-cb8beb5cab1f taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.069329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.069594] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1239a97f-168b-4b62-8d1a-038b37395070 with status ACTIVE [ 897.069839] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.069984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.070078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.070680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.070680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.070785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.070833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.070958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.071213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.071344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.071531] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.071635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.071730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.071878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.071967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.072164] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1239a97f-168b-4b62-8d1a-038b37395070 is going to be updated. [ 897.095301] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.095451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.095519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.095723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.095859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.096044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1239a97f-168b-4b62-8d1a-038b37395070" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.482846] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 in Status: SUCCESS [ 897.483096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.483263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.483521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.483716] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.483839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.483906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.484099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.484187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.484272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.484383] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.572766] env[65161]: INFO networking_nsxv3.common.synchronization [req-e0427520-af91-46c4-a8f5-0efc1700eb13 req-3f9a81a4-afa0-48ba-add4-8729a31325e1 tempest-MultipleCreateTestJSON-565628387 tempest-MultipleCreateTestJSON-565628387-project-member] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 897.573385] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 897.573741] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.573867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.573935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.574162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.574328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.574429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.574508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.574671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.574760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.574854] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.576042] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.925359] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.925554] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.925678] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.926209] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.926478] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.926638] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.926754] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.926975] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.927130] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.927335] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.927446] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.927552] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.927663] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.927757] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.927861] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.927998] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.950490] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.951166] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.951373] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.951586] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.951960] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-e3c19654-370c-42c7-b332-85018d245e9f taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.952199] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-e3c19654-370c-42c7-b332-85018d245e9f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.952348] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-e3c19654-370c-42c7-b332-85018d245e9f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.952746] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-e3c19654-370c-42c7-b332-85018d245e9f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.952928] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c19654-370c-42c7-b332-85018d245e9f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.987226] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.080262] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.080262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.080262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.080262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.080643] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.080762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.081528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.081528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.081528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.082798] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f is going to be created. [ 898.109194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.109501] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.109631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.111667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.111667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.111667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.111667] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 898.112990] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.113212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.113389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.113605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.113760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.126162] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f in Status: UNINITIALIZED for 2s [ 898.145942] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.146144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.146190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.146383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.146525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.158046] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 898.457027] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.457361] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.457600] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.457902] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.458073] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.458229] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port e3c19654-370c-42c7-b332-85018d245e9f not found, creating... [ 898.458520] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.458769] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.458921] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.461587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.461587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.461587] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.461587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.461587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.461587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.461587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.461587] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: e3c19654-370c-42c7-b332-85018d245e9f is going to be created. [ 898.482425] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.482746] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.482856] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.484055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.484055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.484055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-e3c19654-370c-42c7-b332-85018d245e9f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.493975] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c38cb053-aec9-4ead-86a8-4aa3f2154903: rpc.has_security_group_logging(os_id): False [ 898.513910] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.514086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.514201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.514377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.514450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.514707] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.514837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.514912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.515026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.515113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.515189] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 is going to be created. [ 898.612676] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.613210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.613210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.613210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.613470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.637442] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 in Status: IN_PROGRESS for 2s [ 899.203534] env[65161]: INFO networking_nsxv3.common.synchronization [req-e0427520-af91-46c4-a8f5-0efc1700eb13 req-9902557b-2060-43c0-b6f0-43cd6de2574f service nova] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_rules [ 899.203585] env[65161]: INFO networking_nsxv3.common.synchronization [req-e0427520-af91-46c4-a8f5-0efc1700eb13 req-9902557b-2060-43c0-b6f0-43cd6de2574f service nova] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 899.203688] env[65161]: INFO networking_nsxv3.common.synchronization [req-e0427520-af91-46c4-a8f5-0efc1700eb13 req-9902557b-2060-43c0-b6f0-43cd6de2574f service nova] Enqueued Resource ID: e3c19654-370c-42c7-b332-85018d245e9f with Priority: HIGHEST for action port [ 899.203970] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_rules [ 899.204120] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 899.204218] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3c19654-370c-42c7-b332-85018d245e9f with Priority: HIGHEST for action port [ 899.204770] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.204957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.204957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.205336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.205419] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.207120] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.207214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.207346] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3c19654-370c-42c7-b332-85018d245e9f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.207482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3c19654-370c-42c7-b332-85018d245e9f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.207559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3c19654-370c-42c7-b332-85018d245e9f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.207735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3c19654-370c-42c7-b332-85018d245e9f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.207814] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c19654-370c-42c7-b332-85018d245e9f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.454089] env[65161]: INFO networking_nsxv3.common.synchronization [req-1da69084-6758-4c25-a735-2f22cd611a8e req-defa24fc-6d8f-422e-9a98-d875091c2a86 tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 899.454089] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 899.454305] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.454428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.454496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.454691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.454848] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.454948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.455022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.455164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.455249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.455341] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.707490] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.707875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.710187] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3c19654-370c-42c7-b332-85018d245e9f with status ACTIVE [ 899.710187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.710187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.710375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.710450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.710543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.710715] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.710891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.710891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.711041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.711179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.711292] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.711382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.711456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.711608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.711680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.711762] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3c19654-370c-42c7-b332-85018d245e9f is going to be updated. [ 899.736425] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.736698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.736800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.737071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.737268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.737502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3c19654-370c-42c7-b332-85018d245e9f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.960945] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.140706] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f in Status: SUCCESS [ 900.140934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.141151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.141382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.141575] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.141864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.141864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.142041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.142041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.142129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.142191] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.170605] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 900.171036] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa deletion is rescheduled due to dependency. [ 900.171124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.171341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.171683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.171963] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.172164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.172275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.172569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.172699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.172967] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.457638] env[65161]: INFO networking_nsxv3.common.synchronization [req-e0427520-af91-46c4-a8f5-0efc1700eb13 req-d23dfed5-bb30-4c3b-829b-5b5066e37be7 tempest-MultipleCreateTestJSON-565628387 tempest-MultipleCreateTestJSON-565628387-project-member] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 900.457638] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 900.458125] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.458486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.464231] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.644455] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.676224] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.760157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 in Status: SUCCESS [ 900.760476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.803578] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-439 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.803772] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.803895] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.804190] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.804445] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.804604] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.804733] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.804927] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.805144] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.805361] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.805475] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.805586] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.805696] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.805824] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.806019] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.806173] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.825526] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.825693] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 900.825833] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.826019] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-439" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.826336] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.826508] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.826628] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.827317] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.827467] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3965411-a0cb-41fa-bbe6-fd3983aaf89f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.965499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.965744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.965744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.965952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.966073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.966177] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 901.013130] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.013262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.013356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.013524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.013687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.025475] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 901.149297] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70c8e546-9b00-4441-97c1-cb8beb5cab1f: rpc.has_security_group_logging(os_id): False [ 901.172684] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.172890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.172932] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.173248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.173401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.173684] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.173845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.173845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.174076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.174194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.174300] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f is going to be created. [ 901.178558] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.264435] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.264916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.264916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.265192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.265397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.297892] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f in Status: IN_PROGRESS for 2s [ 901.330374] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.330673] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.330804] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.331114] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.331266] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.331424] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port c3965411-a0cb-41fa-bbe6-fd3983aaf89f not found, creating... [ 901.331688] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.331848] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.331961] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.332278] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.332480] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.332931] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.333167] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.333234] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.333477] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.333611] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.333751] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: c3965411-a0cb-41fa-bbe6-fd3983aaf89f is going to be created. [ 901.375096] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.375096] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.375363] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.375658] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.375934] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.376245] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.682076] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.682076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.682076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.682076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.682076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.682528] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 901.711891] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.712057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.712129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.712343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.712577] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.721235] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 902.084903] env[65161]: INFO networking_nsxv3.common.synchronization [req-e0427520-af91-46c4-a8f5-0efc1700eb13 req-66527104-7621-4590-952f-91d789833949 service nova] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_rules [ 902.085219] env[65161]: INFO networking_nsxv3.common.synchronization [req-e0427520-af91-46c4-a8f5-0efc1700eb13 req-66527104-7621-4590-952f-91d789833949 service nova] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 902.085219] env[65161]: INFO networking_nsxv3.common.synchronization [req-e0427520-af91-46c4-a8f5-0efc1700eb13 req-66527104-7621-4590-952f-91d789833949 service nova] Enqueued Resource ID: c3965411-a0cb-41fa-bbe6-fd3983aaf89f with Priority: HIGHEST for action port [ 902.085853] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_rules [ 902.086948] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 902.087087] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3965411-a0cb-41fa-bbe6-fd3983aaf89f with Priority: HIGHEST for action port [ 902.089929] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.090095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.090309] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.090429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.090578] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.091172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.091372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.091490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.091577] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3965411-a0cb-41fa-bbe6-fd3983aaf89f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.593864] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3965411-a0cb-41fa-bbe6-fd3983aaf89f with status ACTIVE [ 902.594179] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.594537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.594537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.595200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.595200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.595200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.595363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.595363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.595588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.595655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.596139] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.596139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.596139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.596331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.596331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.596420] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3965411-a0cb-41fa-bbe6-fd3983aaf89f is going to be updated. [ 902.618755] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.618859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.618974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.619388] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.619539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.619717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3965411-a0cb-41fa-bbe6-fd3983aaf89f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.037625] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 903.038202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.310044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f in Status: SUCCESS [ 903.310044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.732948] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 903.733184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.733407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.733647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.733864] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.733990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.734068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.734323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.735037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.735037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.735037] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.735687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.735917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.736145] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.736325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.736400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.736492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.736596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.736745] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.238460] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.238645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.238802] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.742204] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.246118] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.246432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.246432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.248086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.248086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.248086] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 905.282695] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.282834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.282915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.283211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.283377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.293539] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 907.088864] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 907.089195] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 907.316489] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 907.316764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.316974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.317269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.317480] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.317606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.317663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.317840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.318010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.318203] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.821719] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.902493] env[65161]: INFO networking_nsxv3.common.synchronization [None req-03327d9a-f20e-4940-97d0-41a292eae887 tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_rules [ 907.903306] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_rules [ 907.903754] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.903922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.904015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.904343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.904343] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.985183] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7021fea8-bf0e-4883-9c34-6fb39c41910d tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_rules [ 907.985783] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_rules [ 907.986017] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.986133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.324458] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.425397] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.425708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.426493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.426776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.427119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.427119] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 already deleted. [ 908.427119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.427346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.427623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.427745] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.827570] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.828431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.828431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.828431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.828431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.828431] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 908.861024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.861024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.861024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.861024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.861024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.869530] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 908.949865] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.950029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.950103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.950320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.950543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.950598] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 already deleted. [ 908.950715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.879654] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 910.879820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.879907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.880113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.880372] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.880489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.880489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.880689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.880734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.880815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.880985] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.881091] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.881142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.881479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.881479] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.881627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.881627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.881712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.881755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.881830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.885019] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.385299] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa: rpc.has_security_group_logging(os_id): False [ 911.406723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.406930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.406930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.407166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.407258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.407488] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.408644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.408644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.408644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.408644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.408644] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.408644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.408644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.408644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.408644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.408644] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.409196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.409196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.409196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.409196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.409196] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 911.482897] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.482897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.482897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.483311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.483311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.505243] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 912.352108] env[65161]: INFO networking_nsxv3.common.synchronization [req-6e69253e-7ce4-4322-8551-b784ef203b5f req-8976f664-6ebe-4332-8740-3fd023303a04 tempest-MultipleCreateTestJSON-565628387 tempest-MultipleCreateTestJSON-565628387-project-member] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 912.352718] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 912.353109] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.353266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.353338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.353546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.353697] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.353851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.353895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.354052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.354166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.354231] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.385659] env[65161]: INFO networking_nsxv3.common.synchronization [req-b7f7971a-229c-457d-869c-3c8fa7aa488e req-9a3d9b64-45a5-4fc9-883a-d639354956e2 tempest-MultipleCreateTestJSON-565628387 tempest-MultipleCreateTestJSON-565628387-project-member] Enqueued Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 912.387324] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa with Priority: HIGHEST for action security_group_members [ 912.387891] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.387997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.855930] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.361053] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.521088] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 913.521373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.521653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.521878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.521968] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.865611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.865611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.865611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.865611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.865611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.865611] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be updated. [ 913.893864] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.894013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.894133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.894296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.894446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.904954] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: IN_PROGRESS for 2s [ 914.043816] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.043816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.043934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.044484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.044484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.044484] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be deleted. [ 914.117863] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.118101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.118205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.118461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.118579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.118693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.876343] env[65161]: INFO networking_nsxv3.common.synchronization [None req-18dfb353-5ea5-49d2-8822-065e9d693f20 None None] Enqueued Resource ID: d7d22c27-bb88-4c2a-9931-517e924ff749 with Priority: HIGHEST for action port [ 914.876852] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7d22c27-bb88-4c2a-9931-517e924ff749 with Priority: HIGHEST for action port [ 914.877184] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7d22c27-bb88-4c2a-9931-517e924ff749 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.877318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7d22c27-bb88-4c2a-9931-517e924ff749" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.877401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7d22c27-bb88-4c2a-9931-517e924ff749" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.877877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7d22c27-bb88-4c2a-9931-517e924ff749" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.877969] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7d22c27-bb88-4c2a-9931-517e924ff749',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.380250] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7d22c27-bb88-4c2a-9931-517e924ff749 [ 915.380483] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.380613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.380682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.380912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.381009] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.381115] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7d22c27-bb88-4c2a-9931-517e924ff749 already deleted. [ 915.381198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7d22c27-bb88-4c2a-9931-517e924ff749" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.493575] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1146a37-eba0-4dc2-b4e0-bc26c6bd3207 req-322506ed-b7b5-44b5-912f-416e911db260 tempest-ServerMetadataTestJSON-2091540528 tempest-ServerMetadataTestJSON-2091540528-project-member] Enqueued Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGHEST for action security_group_members [ 915.495391] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGHEST for action security_group_members [ 915.495838] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.495991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.496133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.496466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.496677] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.496815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.498482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.498605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.498724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.498905] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.670617] env[65161]: INFO networking_nsxv3.common.synchronization [req-122ff334-33c6-4b75-be65-1e2b701f9ee9 req-afb07b36-c484-4d5f-9fdc-a7c0f371f896 tempest-ServersWithSpecificFlavorTestJSON-1681046468 tempest-ServersWithSpecificFlavorTestJSON-1681046468-project-member] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 915.671201] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 915.671503] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.671644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.671712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.671909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.672088] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.672192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.672254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.672473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.672706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.672852] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.916864] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa in Status: SUCCESS [ 915.916864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.916864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.916864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.916864] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.916864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.916864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.917483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.917483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.917483] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('494ab5ab-6967-4eb3-bee6-73cd0bcd16fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.986021] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-351 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.986021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-351" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.986021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-351" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.986021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-351" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.986021] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.986021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.986021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.986687] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.986953] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.987316] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.987548] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.987750] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.987950] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.988169] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.988357] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.988583] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.001871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.002035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.002112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.002351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.002468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.002686] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.002838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.002914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.003094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.003170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.003256] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 already deleted. [ 916.003354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.008356] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.008499] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.008638] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.009347] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-351" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.009347] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-5f152ee3-80b7-4707-bec0-019f97bf02c1 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.009533] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-5f152ee3-80b7-4707-bec0-019f97bf02c1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.009645] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-5f152ee3-80b7-4707-bec0-019f97bf02c1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.009915] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-5f152ee3-80b7-4707-bec0-019f97bf02c1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.010061] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f152ee3-80b7-4707-bec0-019f97bf02c1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.175909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.176177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.176177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.176387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.176387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.178369] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.178369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.178369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.178369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.178369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.178369] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 is going to be updated. [ 916.217109] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.217109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.217109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.217109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.217402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.227332] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: IN_PROGRESS for 2s [ 916.421580] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.421757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.421794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.422184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.422184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.422324] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.422500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.422584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.422716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.422792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.422877] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 494ab5ab-6967-4eb3-bee6-73cd0bcd16fa is going to be deleted. [ 916.458880] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.458880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.458880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.458880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.458880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.458880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-494ab5ab-6967-4eb3-bee6-73cd0bcd16fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.512956] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.513246] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.513366] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.513657] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.513795] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.513948] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 5f152ee3-80b7-4707-bec0-019f97bf02c1 not found, creating... [ 916.514235] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.514397] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.514514] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.514750] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.514904] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.515209] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.515366] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.515483] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.515721] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.515858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.515997] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 5f152ee3-80b7-4707-bec0-019f97bf02c1 is going to be created. [ 916.536247] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.536471] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.536574] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.536939] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.537118] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.537356] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-5f152ee3-80b7-4707-bec0-019f97bf02c1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.310997] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1146a37-eba0-4dc2-b4e0-bc26c6bd3207 req-63d70395-de17-450f-bbb6-ec09df22d058 service nova] Enqueued Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGHEST for action security_group_rules [ 917.311274] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1146a37-eba0-4dc2-b4e0-bc26c6bd3207 req-63d70395-de17-450f-bbb6-ec09df22d058 service nova] Enqueued Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGHEST for action security_group_members [ 917.311342] env[65161]: INFO networking_nsxv3.common.synchronization [req-d1146a37-eba0-4dc2-b4e0-bc26c6bd3207 req-63d70395-de17-450f-bbb6-ec09df22d058 service nova] Enqueued Resource ID: 5f152ee3-80b7-4707-bec0-019f97bf02c1 with Priority: HIGHEST for action port [ 917.312364] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGHEST for action security_group_rules [ 917.312543] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGHEST for action security_group_members [ 917.312658] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f152ee3-80b7-4707-bec0-019f97bf02c1 with Priority: HIGHEST for action port [ 917.312931] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.313069] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.313138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.313404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.313495] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.314475] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.314610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.314680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.314874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.315042] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.315142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.315272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.317729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.317729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.317729] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.318720] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f152ee3-80b7-4707-bec0-019f97bf02c1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.318832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f152ee3-80b7-4707-bec0-019f97bf02c1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.318892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f152ee3-80b7-4707-bec0-019f97bf02c1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.319123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f152ee3-80b7-4707-bec0-019f97bf02c1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.319209] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f152ee3-80b7-4707-bec0-019f97bf02c1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.372360] env[65161]: INFO networking_nsxv3.common.synchronization [None req-9d58cff0-9d12-4685-8d14-30c6361330de None None] Enqueued Resource ID: b463b789-0e0b-402f-9d09-9a2c17b7bc33 with Priority: HIGHEST for action port [ 917.372360] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b463b789-0e0b-402f-9d09-9a2c17b7bc33 with Priority: HIGHEST for action port [ 917.372634] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b463b789-0e0b-402f-9d09-9a2c17b7bc33 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.372634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b463b789-0e0b-402f-9d09-9a2c17b7bc33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.372717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b463b789-0e0b-402f-9d09-9a2c17b7bc33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.373015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b463b789-0e0b-402f-9d09-9a2c17b7bc33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.373098] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b463b789-0e0b-402f-9d09-9a2c17b7bc33',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.657754] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7c957c98-5df4-4021-8fbc-feb567e18f91 None None] Enqueued Resource ID: cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa with Priority: HIGHEST for action port [ 917.659658] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa with Priority: HIGHEST for action port [ 917.659658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.659658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.659658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.664023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.664023] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.825285] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.825285] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.825285] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f152ee3-80b7-4707-bec0-019f97bf02c1 with status ACTIVE [ 917.825285] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.825285] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.825285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.825921] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.826157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.826302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.826754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.827087] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.827265] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f152ee3-80b7-4707-bec0-019f97bf02c1 is going to be updated. [ 917.849922] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.850366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.850628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.850976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.851236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.851686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f152ee3-80b7-4707-bec0-019f97bf02c1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.877055] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b463b789-0e0b-402f-9d09-9a2c17b7bc33 [ 917.877399] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.877983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.877983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.878219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.878298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.878441] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b463b789-0e0b-402f-9d09-9a2c17b7bc33 already deleted. [ 917.878628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b463b789-0e0b-402f-9d09-9a2c17b7bc33" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.162496] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa [ 918.163203] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.163613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.164335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.164335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.164335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.164335] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa already deleted. [ 918.164335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc14d676-6fcd-4a3d-8d8c-75f5c51d56fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.236924] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: SUCCESS [ 918.237131] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 deletion is rescheduled due to dependency. [ 918.237249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.330887] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.837871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.837871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.837871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.837871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.837871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.837871] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 is going to be created. [ 918.865815] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.865815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.865815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.865815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.865815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.877978] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 in Status: UNINITIALIZED for 2s [ 920.262661] env[65161]: INFO networking_nsxv3.common.synchronization [None req-44ab0fd5-213e-483e-960a-e190717840ea None None] Enqueued Resource ID: dbd4d29e-ad56-4743-8cef-05f1bbda362d with Priority: HIGHEST for action port [ 920.263438] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbd4d29e-ad56-4743-8cef-05f1bbda362d with Priority: HIGHEST for action port [ 920.263861] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbd4d29e-ad56-4743-8cef-05f1bbda362d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.263988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbd4d29e-ad56-4743-8cef-05f1bbda362d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.264080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbd4d29e-ad56-4743-8cef-05f1bbda362d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.264386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbd4d29e-ad56-4743-8cef-05f1bbda362d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.265249] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbd4d29e-ad56-4743-8cef-05f1bbda362d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.378992] env[65161]: INFO networking_nsxv3.common.synchronization [req-73656c61-ee91-420c-bd89-20de9c202aed req-54be891c-63a2-4592-bc23-c18da085be8b tempest-ServersAdminTestJSON-2133010713 tempest-ServersAdminTestJSON-2133010713-project-member] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 920.379736] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGHEST for action security_group_members [ 920.380454] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.380454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.380454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.380454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.380686] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.380686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.380764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.380874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.380959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.381110] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.766350] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbd4d29e-ad56-4743-8cef-05f1bbda362d [ 920.766596] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.766765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.766882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.767130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.767221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.767317] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbd4d29e-ad56-4743-8cef-05f1bbda362d already deleted. [ 920.767397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbd4d29e-ad56-4743-8cef-05f1bbda362d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.882885] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.883074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.883154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.883449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.892549] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 in Status: SUCCESS [ 920.892549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.892549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.892747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.892957] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.893067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.893112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.893274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.893383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.893419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.893509] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.904353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.904353] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.904353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.904353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.904587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.904587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.904642] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be updated. [ 920.930437] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.930621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.930741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.930891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.931056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.939610] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: IN_PROGRESS for 2s [ 921.395673] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.396102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.396102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.396385] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.396674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.396854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.396982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.399037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.399037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.399037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.399037] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.399037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.399037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.399037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.399037] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.399037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.399603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.399603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.399603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.399603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.399786] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.749860] env[65161]: INFO networking_nsxv3.common.synchronization [req-9dc621c5-0320-457d-bdbc-a1826c67a80d req-839c293d-20f2-4d51-89c7-b3ac9ddd9bc7 tempest-ImagesOneServerNegativeTestJSON-1819154006 tempest-ImagesOneServerNegativeTestJSON-1819154006-project-member] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 921.750430] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 921.750939] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.751055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.751137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.752259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.752259] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.752539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.752539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.752664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.752770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.752900] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.903258] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 059fa2a0-aacc-4252-8c71-d7658bfb6fb6: rpc.has_security_group_logging(os_id): False [ 921.923568] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.923716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.923790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.923986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.924089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.924278] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.924377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.924441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.924604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.924682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.924893] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.924990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.925063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.925204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.925279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.925471] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.925565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.925626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.925762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.925836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.925919] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 is going to be created. [ 921.987231] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.987231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.987231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.987231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.987231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.997777] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 in Status: IN_PROGRESS for 2s [ 922.165630] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.167251] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.168161] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.168365] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.168545] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.168717] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.168829] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.169071] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.169252] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.173070] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.173070] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.173070] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.173070] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.173070] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.173070] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.173070] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.191831] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.191986] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.192160] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.192340] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.192703] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-1743478e-df60-46b3-a6d6-c97b03464668 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.192881] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-1743478e-df60-46b3-a6d6-c97b03464668" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.193021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-1743478e-df60-46b3-a6d6-c97b03464668" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.193457] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-1743478e-df60-46b3-a6d6-c97b03464668" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.193457] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1743478e-df60-46b3-a6d6-c97b03464668',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.256446] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.256609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.256685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.256924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.257059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.257225] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.257328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.257393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.257552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.257635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.257722] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e already deleted. [ 922.257802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.696538] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.696893] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.697111] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.697507] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.697707] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.697869] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 1743478e-df60-46b3-a6d6-c97b03464668 not found, creating... [ 922.698160] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.698321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.698456] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.698772] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.698952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.699318] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.699479] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.699598] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.699806] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.699936] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.700088] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 1743478e-df60-46b3-a6d6-c97b03464668 is going to be created. [ 922.721271] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.721476] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.721596] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.721864] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.722092] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.722312] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-1743478e-df60-46b3-a6d6-c97b03464668" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.950561] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 in Status: SUCCESS [ 922.950561] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 deletion is rescheduled due to dependency. [ 922.950792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.488073] env[65161]: INFO networking_nsxv3.common.synchronization [req-9dc621c5-0320-457d-bdbc-a1826c67a80d req-d19c78bf-eb56-408b-9ea4-52f9632829ea service nova] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_rules [ 923.488271] env[65161]: INFO networking_nsxv3.common.synchronization [req-9dc621c5-0320-457d-bdbc-a1826c67a80d req-d19c78bf-eb56-408b-9ea4-52f9632829ea service nova] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 923.488402] env[65161]: INFO networking_nsxv3.common.synchronization [req-9dc621c5-0320-457d-bdbc-a1826c67a80d req-d19c78bf-eb56-408b-9ea4-52f9632829ea service nova] Enqueued Resource ID: 1743478e-df60-46b3-a6d6-c97b03464668 with Priority: HIGHEST for action port [ 923.488923] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_rules [ 923.489347] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 923.489487] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1743478e-df60-46b3-a6d6-c97b03464668 with Priority: HIGHEST for action port [ 923.489962] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.489962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.490113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.490113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.490113] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.494559] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.495880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.496102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.496283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.496450] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.496623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.496623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.496768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.496877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.496990] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.497856] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-1743478e-df60-46b3-a6d6-c97b03464668 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.497986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1743478e-df60-46b3-a6d6-c97b03464668" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.498074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1743478e-df60-46b3-a6d6-c97b03464668" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.500311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1743478e-df60-46b3-a6d6-c97b03464668" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.500311] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1743478e-df60-46b3-a6d6-c97b03464668',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.001352] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.002470] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.002624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.002933] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1743478e-df60-46b3-a6d6-c97b03464668 with status ACTIVE [ 924.003149] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.003264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.003327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.003541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.003636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.004859] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.004859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.004859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.004859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.004859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.004859] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.004859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.004859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.004859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.004859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.004859] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1743478e-df60-46b3-a6d6-c97b03464668 is going to be updated. [ 924.012305] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 in Status: SUCCESS [ 924.012392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.029047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.029047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.029047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.029359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.029359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.029415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1743478e-df60-46b3-a6d6-c97b03464668" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.503663] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.007776] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.008131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.008131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.008324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.008410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.008544] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be created. [ 925.031483] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.031698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.031855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.032309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.032580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.047252] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: UNINITIALIZED for 2s [ 926.445959] env[65161]: INFO networking_nsxv3.common.synchronization [req-a570d288-4997-4055-922e-735257485a5f req-45672385-9300-42f9-ac19-34ba32ece867 tempest-ListServerFiltersTestJSON-655968173 tempest-ListServerFiltersTestJSON-655968173-project-member] Enqueued Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 926.446919] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6704a80-3529-40ab-83a5-1a8a6167b498 with Priority: HIGHEST for action security_group_members [ 926.447021] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6704a80-3529-40ab-83a5-1a8a6167b498 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.447118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.447176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.448500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.448500] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.448500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.448500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.448500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.448500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.448500] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6704a80-3529-40ab-83a5-1a8a6167b498',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.652033] env[65161]: INFO networking_nsxv3.common.synchronization [req-bdcd14b2-180b-4877-88ae-3d01cb3c85c8 req-a29e6268-9c6c-492d-b8f0-ad89b98b1600 tempest-ServersNegativeTestJSON-2079955183 tempest-ServersNegativeTestJSON-2079955183-project-member] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 926.652033] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 926.652033] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.652033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.652033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.652033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.652364] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.652364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.652364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.652524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.652524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.652806] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.953367] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.953544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.953634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.953889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.955723] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.955925] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.956033] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.956273] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.956525] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.956703] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.956820] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.957055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.957199] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.957422] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 926.957540] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.957650] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.957745] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.957862] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 926.957964] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.958113] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.978031] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.978031] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 926.978209] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.978270] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.980487] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-681d6c1c-06c6-4a74-9d8e-036380a3c48c taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.980487] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-681d6c1c-06c6-4a74-9d8e-036380a3c48c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.980487] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-681d6c1c-06c6-4a74-9d8e-036380a3c48c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.980487] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-681d6c1c-06c6-4a74-9d8e-036380a3c48c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.980487] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('681d6c1c-06c6-4a74-9d8e-036380a3c48c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.981907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.982172] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.982297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.982354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.982604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.982691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.982782] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 is going to be updated. [ 927.012455] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.012667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.012742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.012976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.013150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.022546] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: IN_PROGRESS for 2s [ 927.058480] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 927.058480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.058480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.058480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.058480] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.058859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.058859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.058859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.058965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.059597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.059597] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.155459] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.485916] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.486363] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.486363] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.486824] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.486824] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.486824] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 681d6c1c-06c6-4a74-9d8e-036380a3c48c not found, creating... [ 927.487178] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.487280] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.487352] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.487568] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.487707] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.488010] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.488150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.488264] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.488464] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.488595] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.488730] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 681d6c1c-06c6-4a74-9d8e-036380a3c48c is going to be created. [ 927.512538] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.512780] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.512929] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.513371] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.513553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.513833] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-681d6c1c-06c6-4a74-9d8e-036380a3c48c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.562116] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.562271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.562346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.562599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.562770] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.562885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.562936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.563111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.563197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.563296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.563449] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.563589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.563589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.563739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.563871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.563961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.564034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.564170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.564247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.564329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.564418] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.658272] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.069144] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20c8c1aa-e142-4f0d-9654-9180daa1078e: rpc.has_security_group_logging(os_id): False [ 928.092733] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.092962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.093115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.093543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.093737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.094147] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.094323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.094422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.094733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.094844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.095235] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.095471] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.095517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.095756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.096037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.096256] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.096410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.096525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.096782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.096946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.097121] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be created. [ 928.161272] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.161272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.161457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.161517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.161718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.163071] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.163213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.163280] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.163509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.163667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.163712] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be updated. [ 928.179604] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 928.193340] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.193487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.193617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.193826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.193972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.226200] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 2s [ 928.289023] env[65161]: INFO networking_nsxv3.common.synchronization [req-bdcd14b2-180b-4877-88ae-3d01cb3c85c8 req-03e57f1f-a383-4276-bbe5-4296d21f145b service nova] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_rules [ 928.289367] env[65161]: INFO networking_nsxv3.common.synchronization [req-bdcd14b2-180b-4877-88ae-3d01cb3c85c8 req-03e57f1f-a383-4276-bbe5-4296d21f145b service nova] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 928.289649] env[65161]: INFO networking_nsxv3.common.synchronization [req-bdcd14b2-180b-4877-88ae-3d01cb3c85c8 req-03e57f1f-a383-4276-bbe5-4296d21f145b service nova] Enqueued Resource ID: 681d6c1c-06c6-4a74-9d8e-036380a3c48c with Priority: HIGHEST for action port [ 928.290356] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_rules [ 928.290565] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 928.290725] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 681d6c1c-06c6-4a74-9d8e-036380a3c48c with Priority: HIGHEST for action port [ 928.291119] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.291527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.291636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.291924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.292056] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.293144] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.293248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.293446] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-681d6c1c-06c6-4a74-9d8e-036380a3c48c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.293626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-681d6c1c-06c6-4a74-9d8e-036380a3c48c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.293790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-681d6c1c-06c6-4a74-9d8e-036380a3c48c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.294014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-681d6c1c-06c6-4a74-9d8e-036380a3c48c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.294109] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('681d6c1c-06c6-4a74-9d8e-036380a3c48c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.798091] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.798331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.798567] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 681d6c1c-06c6-4a74-9d8e-036380a3c48c with status ACTIVE [ 928.798625] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.798738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.798809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.799452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.799452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.799452] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.799452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.799452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.800159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.800159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.800159] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.800159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.800159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.800323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.800323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.800439] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 681d6c1c-06c6-4a74-9d8e-036380a3c48c is going to be updated. [ 928.822177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.822331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.822407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.822724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.822860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.823030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-681d6c1c-06c6-4a74-9d8e-036380a3c48c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.032546] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6704a80-3529-40ab-83a5-1a8a6167b498 in Status: SUCCESS [ 929.032668] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6704a80-3529-40ab-83a5-1a8a6167b498 deletion is rescheduled due to dependency. [ 929.032769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6704a80-3529-40ab-83a5-1a8a6167b498" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.191780] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 930.192105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.237038] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 4s [ 930.447491] env[65161]: INFO networking_nsxv3.common.synchronization [req-8f53e0fa-146a-4564-bf49-4b42930bac6f req-8b4bba9e-55e7-44b8-8b55-4a46b4854db5 tempest-ServerMetadataTestJSON-2091540528 tempest-ServerMetadataTestJSON-2091540528-project-member] Enqueued Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGHEST for action security_group_members [ 930.448392] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGHEST for action security_group_members [ 930.448956] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.449182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.449318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.449555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.449832] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.450032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.450130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.450325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.450412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.450556] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.955504] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.955671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.955742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.955965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.956064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.956260] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.956360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.956422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.956588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.956711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.956767] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 is going to be updated. [ 930.984785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.984965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.985041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.985228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.985390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.998935] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 in Status: IN_PROGRESS for 2s [ 931.569146] env[65161]: INFO networking_nsxv3.common.synchronization [req-0efabbe0-f3af-4406-b5ae-da3188136d22 req-d805de4a-551f-4b96-8815-f56a83ffb79c tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 931.569679] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 931.569994] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.570177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.570927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.570927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.570927] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.570927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.570927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.571153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.571153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.571209] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.951419] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.951565] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.951648] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.951917] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.952249] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.952351] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.952470] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.952791] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.953076] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.953213] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.953326] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.953778] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.953778] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.953954] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.954505] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.954505] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.974369] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.974525] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 931.974667] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.974929] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.975288] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.975470] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.975591] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.975927] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.976079] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.074944] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.075118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.075169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.075409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.075544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.075743] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.075869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.075975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.076114] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.076204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.076299] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 already deleted. [ 932.076350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.250284] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 932.250829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.251224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.251530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.251778] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.251982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.252110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.252449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.252449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.252647] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.478980] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.479331] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.479499] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.479883] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.480072] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.481155] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b not found, creating... [ 932.481155] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.481155] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.481155] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.481381] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.481528] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.481941] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.482134] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.482332] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.482632] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.482814] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.483737] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b is going to be created. [ 932.505243] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.505543] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.505726] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.506830] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.506830] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.506830] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.756248] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.005594] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 in Status: SUCCESS [ 933.005786] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 deletion is rescheduled due to dependency. [ 933.005901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.246384] env[65161]: INFO networking_nsxv3.common.synchronization [req-0efabbe0-f3af-4406-b5ae-da3188136d22 req-91cf4050-4250-43fa-99a1-a6369dd5a263 service nova] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_rules [ 933.247559] env[65161]: INFO networking_nsxv3.common.synchronization [req-0efabbe0-f3af-4406-b5ae-da3188136d22 req-91cf4050-4250-43fa-99a1-a6369dd5a263 service nova] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 933.247559] env[65161]: INFO networking_nsxv3.common.synchronization [req-0efabbe0-f3af-4406-b5ae-da3188136d22 req-91cf4050-4250-43fa-99a1-a6369dd5a263 service nova] Enqueued Resource ID: fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b with Priority: HIGHEST for action port [ 933.247559] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_rules [ 933.248483] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 933.248731] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b with Priority: HIGHEST for action port [ 933.252019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.252019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.252019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.252019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.252019] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.252019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.252019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.252019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.252019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.252019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.252019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.252019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.252669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.252847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.253030] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.254379] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.254626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.254779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.255072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.255258] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.261943] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.757336] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.758681] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.758681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.758839] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b with status ACTIVE [ 933.758882] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.759010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.759081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.759287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.760049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.760049] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.760049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.760049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.760049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.760441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.760441] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.760537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.760537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.760756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.760832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.760922] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b is going to be updated. [ 933.762899] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.763059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.763181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.763360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.763451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.763544] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be updated. [ 933.783305] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.783485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.783485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.783973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.784189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.784361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb09fd0d-09f4-490c-9fb3-7dd5a087ff7b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.790763] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.790894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.790968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.791196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.791333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.800797] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 2s [ 934.259247] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.762510] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.762804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.762804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.763011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.763107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.763202] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be created. [ 934.788632] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.788792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.788865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.789089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.789248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.801757] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: UNINITIALIZED for 2s [ 935.813229] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 935.813229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.813734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.813734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.813734] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.813899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.813899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.813997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.814180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.814298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.814395] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.319381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.319544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.319613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.319830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.319986] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.320088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.320151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.320293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.320376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.320483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.320638] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.320726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.320783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.320922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.321109] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.321241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.321288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.321412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.321481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.321566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.321653] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.816755] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: SUCCESS [ 936.816755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.816755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.816755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.816755] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.816755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.816755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.816755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.816755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.816755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.816755] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.823974] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3e3e485-b210-4594-a46e-85922cc804cf: rpc.has_security_group_logging(os_id): False [ 936.842500] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.842741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.842817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.843069] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.843147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.843312] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.843451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.843522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.843751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.843832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.844051] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.844149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.844212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.844356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.844510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.844605] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.844697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.844892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.845061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.845171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.845217] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be updated. [ 936.907036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.907224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.907269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.907464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.907894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.919743] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 2s [ 937.323820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.323820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.323820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.323820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.323820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.324669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.324669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.324669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.324669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.324669] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.383529] env[65161]: INFO networking_nsxv3.common.synchronization [req-ee166536-034f-4d13-820e-ff22b77205a4 req-43098b47-5320-4dff-a9a5-37a7b198ad83 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 937.384349] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 937.384848] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.385066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.385180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.385567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.386445] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.387340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.387392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.387587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.387703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.387810] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.755133] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.755384] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.755543] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.755913] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.757074] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.757074] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.757264] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.757648] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.757729] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.759064] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.759064] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.759064] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.759064] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.759064] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.759064] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.759064] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.781426] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.781587] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.781739] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.781973] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.782342] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.782572] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.782733] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.783114] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.783263] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6d89d03-81d7-4d0b-b68d-3bbed8835d5d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.828209] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f6a93f2-4e06-4cd8-9bde-77501efa88f4: rpc.has_security_group_logging(os_id): False [ 937.852748] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.853085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.853085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.853398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.853488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.853886] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.854103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.854103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.854282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.854362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.854600] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.854699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.854788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.855094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.855200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.855466] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.855636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.855744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.855936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.856037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.856147] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be created. [ 937.890489] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.890986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.890986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.891121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.891199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.891398] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.891498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.891672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.891929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.892045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.892466] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 already deleted. [ 937.892652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.930771] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.931071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.931071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.931307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.931560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.950911] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: IN_PROGRESS for 2s [ 937.996548] env[65161]: INFO networking_nsxv3.common.synchronization [None req-0212ad75-07e5-4ecd-9880-b656e96faa79 None None] Enqueued Resource ID: 4624e8e6-ec6c-4dd2-a55d-2a9845151ebf with Priority: HIGHEST for action port [ 937.997339] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4624e8e6-ec6c-4dd2-a55d-2a9845151ebf with Priority: HIGHEST for action port [ 937.997747] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-4624e8e6-ec6c-4dd2-a55d-2a9845151ebf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.997885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4624e8e6-ec6c-4dd2-a55d-2a9845151ebf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.997953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4624e8e6-ec6c-4dd2-a55d-2a9845151ebf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.998242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4624e8e6-ec6c-4dd2-a55d-2a9845151ebf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.998341] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4624e8e6-ec6c-4dd2-a55d-2a9845151ebf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.286016] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.288483] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.288483] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.288483] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.288483] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.288483] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port e6d89d03-81d7-4d0b-b68d-3bbed8835d5d not found, creating... [ 938.288483] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.288483] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.288905] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.288905] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.289093] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.289422] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.289600] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.289756] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.290071] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.290249] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.290442] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: e6d89d03-81d7-4d0b-b68d-3bbed8835d5d is going to be created. [ 938.315100] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.315238] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.315290] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.315741] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.315827] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.315999] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.503914] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4624e8e6-ec6c-4dd2-a55d-2a9845151ebf [ 938.503914] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.504174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.504174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.504342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.504430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.504521] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4624e8e6-ec6c-4dd2-a55d-2a9845151ebf already deleted. [ 938.504603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4624e8e6-ec6c-4dd2-a55d-2a9845151ebf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.699238] env[65161]: INFO networking_nsxv3.common.synchronization [req-6a026150-1fa4-4c8a-be15-bb797baa2032 req-ca51d018-650b-438e-ab8d-bbdf3fb5e02f tempest-ServersNegativeTestJSON-2079955183 tempest-ServersNegativeTestJSON-2079955183-project-member] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 938.699838] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 938.700149] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.700267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.700343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.700677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.700775] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.700843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.700875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.701021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.701111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.701292] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.934547] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 938.934547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.035494] env[65161]: INFO networking_nsxv3.common.synchronization [req-ee166536-034f-4d13-820e-ff22b77205a4 req-a2fd0c0c-83f9-4ec7-8134-995b06858238 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 939.035494] env[65161]: INFO networking_nsxv3.common.synchronization [req-ee166536-034f-4d13-820e-ff22b77205a4 req-a2fd0c0c-83f9-4ec7-8134-995b06858238 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 939.035494] env[65161]: INFO networking_nsxv3.common.synchronization [req-ee166536-034f-4d13-820e-ff22b77205a4 req-a2fd0c0c-83f9-4ec7-8134-995b06858238 service nova] Enqueued Resource ID: e6d89d03-81d7-4d0b-b68d-3bbed8835d5d with Priority: HIGHEST for action port [ 939.037828] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 939.037828] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 939.037828] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6d89d03-81d7-4d0b-b68d-3bbed8835d5d with Priority: HIGHEST for action port [ 939.037828] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.037828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.037828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.037828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.037828] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.040251] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.040615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.040793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.041093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.041368] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.041608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.042627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.044431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.044431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.044431] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.044886] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.044886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.044886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.045073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.045172] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6d89d03-81d7-4d0b-b68d-3bbed8835d5d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.203476] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.546504] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.548235] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.548235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.548235] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6d89d03-81d7-4d0b-b68d-3bbed8835d5d with status ACTIVE [ 939.548235] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.548235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.548493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.548523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.548605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.548789] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.548927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.548927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.549122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.549199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.549380] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.549466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.549545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.549696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.549777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.549860] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6d89d03-81d7-4d0b-b68d-3bbed8835d5d is going to be updated. [ 939.585237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.585237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.585237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.585237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.585237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.585237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6d89d03-81d7-4d0b-b68d-3bbed8835d5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.706337] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.964062] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: SUCCESS [ 939.964362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.054025] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.209924] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.210108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.210182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.210399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.210489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.210586] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be updated. [ 940.241558] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.241707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.241778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.241992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.242153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.252193] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 2s [ 940.451182] env[65161]: INFO networking_nsxv3.common.synchronization [None req-2a05ab37-1c63-46e5-a558-103b7eb3461e None None] Enqueued Resource ID: 606d6913-9379-4f81-8a87-dd11f86f5ac3 with Priority: HIGHEST for action port [ 940.451790] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606d6913-9379-4f81-8a87-dd11f86f5ac3 with Priority: HIGHEST for action port [ 940.452136] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-606d6913-9379-4f81-8a87-dd11f86f5ac3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.452267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-606d6913-9379-4f81-8a87-dd11f86f5ac3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.452370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-606d6913-9379-4f81-8a87-dd11f86f5ac3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.452733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-606d6913-9379-4f81-8a87-dd11f86f5ac3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.452823] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('606d6913-9379-4f81-8a87-dd11f86f5ac3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.556244] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.556441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.556483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.556694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.556791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.556890] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be created. [ 940.583360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.583607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.583607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.583792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.583961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.595300] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: UNINITIALIZED for 2s [ 940.955990] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 606d6913-9379-4f81-8a87-dd11f86f5ac3 [ 940.956371] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.956649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.956788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.957080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.957178] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.957277] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:606d6913-9379-4f81-8a87-dd11f86f5ac3 already deleted. [ 940.957376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-606d6913-9379-4f81-8a87-dd11f86f5ac3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.262357] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 942.262357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.607228] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 942.607475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.608254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.608474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.608664] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.609324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.609324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.609324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.609324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.609324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.609324] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.116142] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.116142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.116142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.116142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.116142] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.116142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.116142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.116142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.116723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.116723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.116723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.116885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.117656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.117656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.117656] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.117656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.117656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.117656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.119528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.119528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.119528] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.620988] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caaaa94-1988-4a64-baf8-2e9ad4c3a553: rpc.has_security_group_logging(os_id): False [ 943.639595] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.639757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.639814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.640015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.641775] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.641775] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.641775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.642371] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.642371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.642371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.642507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.642507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.642616] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be created. [ 943.702292] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.702442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.702515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.702797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.702979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.717360] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 944.413535] env[65161]: INFO networking_nsxv3.common.synchronization [req-a960c257-2c52-4c99-8e5a-3571ee4c9581 req-7371b191-bb3a-4521-b540-153d54da0dab tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 944.414254] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 944.414582] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.414713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.414774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.415127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.415351] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.416149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.416149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.416149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.416149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.416149] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.439215] env[65161]: INFO networking_nsxv3.common.synchronization [req-95e8b0ab-6461-4dc0-996e-25c91e147d8f req-97e4b56a-c1da-46bb-9a14-fc8d0ef901b6 tempest-MigrationsAdminTest-2053071831 tempest-MigrationsAdminTest-2053071831-project-member] Enqueued Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 944.439912] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 944.441059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.441059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.441059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.441059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.441059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.441059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.441059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.441517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.441517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.441517] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.862352] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.862775] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.862775] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.862963] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.864229] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.864229] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.864229] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.864229] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.864229] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.864229] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.864522] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.864522] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.864866] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.865111] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.865111] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.865243] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.887822] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.888058] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.888210] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.888460] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.888827] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-20c4c675-f57c-4559-96b2-035b7a3a74da taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.889051] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-20c4c675-f57c-4559-96b2-035b7a3a74da" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.889203] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-20c4c675-f57c-4559-96b2-035b7a3a74da" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.889749] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-20c4c675-f57c-4559-96b2-035b7a3a74da" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.890271] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20c4c675-f57c-4559-96b2-035b7a3a74da',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.917998] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.918209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.918209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.918419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.918507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.918736] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.918872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.918935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.919059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.919138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.919224] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 944.944180] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.951381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.951540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.951604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.951798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.951937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.960692] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 945.393319] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.393584] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.393782] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.394116] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.394279] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.394436] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 20c4c675-f57c-4559-96b2-035b7a3a74da not found, creating... [ 945.394718] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.394918] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.395038] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.395286] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.395436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.395737] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.395900] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.396056] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.396277] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.396414] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.396565] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 20c4c675-f57c-4559-96b2-035b7a3a74da is going to be created. [ 945.419389] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.419542] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.419581] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.419914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.420198] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.420506] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-20c4c675-f57c-4559-96b2-035b7a3a74da" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.446436] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.731157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 945.731566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.948923] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.949270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.949270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.949411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.949473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.949551] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee is going to be updated. [ 945.982253] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.982762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.982762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.982892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.982977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.986421] env[65161]: INFO networking_nsxv3.common.synchronization [req-c78fffdd-ba1f-4e89-8a8a-7b8c6495281a req-bef7a776-d2a9-4eea-a2ea-5db89eece7dd tempest-ImagesOneServerNegativeTestJSON-1819154006 tempest-ImagesOneServerNegativeTestJSON-1819154006-project-member] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 945.986958] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 945.987313] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.987453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.987526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.987743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.987926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.988065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.988138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.988314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.988400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.988508] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.992903] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: IN_PROGRESS for 2s [ 946.145155] env[65161]: INFO networking_nsxv3.common.synchronization [req-95e8b0ab-6461-4dc0-996e-25c91e147d8f req-e3a78c17-dc9e-4de4-9132-ea737a667548 service nova] Enqueued Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_rules [ 946.145339] env[65161]: INFO networking_nsxv3.common.synchronization [req-95e8b0ab-6461-4dc0-996e-25c91e147d8f req-e3a78c17-dc9e-4de4-9132-ea737a667548 service nova] Enqueued Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 946.145474] env[65161]: INFO networking_nsxv3.common.synchronization [req-95e8b0ab-6461-4dc0-996e-25c91e147d8f req-e3a78c17-dc9e-4de4-9132-ea737a667548 service nova] Enqueued Resource ID: 20c4c675-f57c-4559-96b2-035b7a3a74da with Priority: HIGHEST for action port [ 946.145703] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_rules [ 946.145833] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 946.146023] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c4c675-f57c-4559-96b2-035b7a3a74da with Priority: HIGHEST for action port [ 946.146498] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.146630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.146680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.147148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.147148] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.149137] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.149137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.149137] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-20c4c675-f57c-4559-96b2-035b7a3a74da taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.149137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20c4c675-f57c-4559-96b2-035b7a3a74da" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.149137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20c4c675-f57c-4559-96b2-035b7a3a74da" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.149428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20c4c675-f57c-4559-96b2-035b7a3a74da" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.149459] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20c4c675-f57c-4559-96b2-035b7a3a74da',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.490192] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.490360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.490432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.490741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.490836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.491067] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.491185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.491245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.491383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.491455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.491541] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 946.530089] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.530295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.530295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.530487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.530636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.540220] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 946.648961] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.649113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.653792] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20c4c675-f57c-4559-96b2-035b7a3a74da with status ACTIVE [ 946.654086] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.654225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.654520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.654616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.654865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.654908] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.655251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.655251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.655251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.655362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.655458] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.655552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.655629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.655992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.656101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.656191] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20c4c675-f57c-4559-96b2-035b7a3a74da is going to be updated. [ 946.682298] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.682298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.682298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.682298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.682298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.682298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20c4c675-f57c-4559-96b2-035b7a3a74da" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.973924] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 946.973924] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b deletion is rescheduled due to dependency. [ 946.973924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.158734] env[65161]: INFO networking_nsxv3.common.synchronization [req-f23025ee-f700-498a-8af3-bcfc3a518c69 req-a245e699-e02f-4cbd-97f6-c452cf13045a tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_members [ 947.159314] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_members [ 947.159855] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.159855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.159855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.160651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.160651] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.160651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.160651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.162081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.162081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.162081] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.587866] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.588094] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.588222] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.588481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.588734] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.588917] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.588997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.589237] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.589380] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.589588] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.589701] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.589806] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.589910] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.590037] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.590145] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.590286] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.609555] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.609753] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.609924] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.610130] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.610446] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-0b0b9379-b5c3-4035-a680-b8ea753caaa5 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.610649] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-0b0b9379-b5c3-4035-a680-b8ea753caaa5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.610787] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-0b0b9379-b5c3-4035-a680-b8ea753caaa5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.611259] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-0b0b9379-b5c3-4035-a680-b8ea753caaa5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.611403] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b0b9379-b5c3-4035-a680-b8ea753caaa5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.664027] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.664027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.664027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.664027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.664027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.664027] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.664027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.664502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.664741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.665217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.665217] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 already deleted. [ 947.665217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.005526] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: SUCCESS [ 948.005526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.005526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.005526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.005918] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.005918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.005918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.006046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.006046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.006477] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.114202] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.114669] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.114908] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.115382] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.115651] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.115911] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 0b0b9379-b5c3-4035-a680-b8ea753caaa5 not found, creating... [ 948.116339] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.116584] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.116782] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.117148] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.117381] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.117824] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.118084] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.118289] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.118647] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.118859] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.119103] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 0b0b9379-b5c3-4035-a680-b8ea753caaa5 is going to be created. [ 948.143274] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.143657] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.143897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.144440] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.144837] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.145136] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-0b0b9379-b5c3-4035-a680-b8ea753caaa5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.508871] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.551174] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 948.551526] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e deletion is rescheduled due to dependency. [ 948.551526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.858909] env[65161]: INFO networking_nsxv3.common.synchronization [req-f23025ee-f700-498a-8af3-bcfc3a518c69 req-dbd45b97-5e57-4930-8c0f-e0ae0b165ebb service nova] Enqueued Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_rules [ 948.859117] env[65161]: INFO networking_nsxv3.common.synchronization [req-f23025ee-f700-498a-8af3-bcfc3a518c69 req-dbd45b97-5e57-4930-8c0f-e0ae0b165ebb service nova] Enqueued Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_members [ 948.859284] env[65161]: INFO networking_nsxv3.common.synchronization [req-f23025ee-f700-498a-8af3-bcfc3a518c69 req-dbd45b97-5e57-4930-8c0f-e0ae0b165ebb service nova] Enqueued Resource ID: 0b0b9379-b5c3-4035-a680-b8ea753caaa5 with Priority: HIGHEST for action port [ 948.859850] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_rules [ 948.859988] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_members [ 948.860656] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b9379-b5c3-4035-a680-b8ea753caaa5 with Priority: HIGHEST for action port [ 948.860975] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.861133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.861199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.861401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.861481] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.864490] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.864631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.864718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.864976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.865194] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.865315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.865381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.865581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.865700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.865815] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.866817] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b0b9379-b5c3-4035-a680-b8ea753caaa5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.866921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b0b9379-b5c3-4035-a680-b8ea753caaa5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.867115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b0b9379-b5c3-4035-a680-b8ea753caaa5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.867297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b0b9379-b5c3-4035-a680-b8ea753caaa5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.867873] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b0b9379-b5c3-4035-a680-b8ea753caaa5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.011147] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.372031] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.372031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.372031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.372031] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b0b9379-b5c3-4035-a680-b8ea753caaa5 with status ACTIVE [ 949.372031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.372031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.372031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.372031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.372031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.372031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.372031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.377491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.377491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.377491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.377491] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.377491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.377491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.377491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.377491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.377491] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b0b9379-b5c3-4035-a680-b8ea753caaa5 is going to be updated. [ 949.401329] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.401558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.401625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.401894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.402104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.402300] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b0b9379-b5c3-4035-a680-b8ea753caaa5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.514702] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.514969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.515068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.515630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.515718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.516201] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee is going to be updated. [ 949.548253] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.548426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.548531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.548722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.548869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.560630] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: IN_PROGRESS for 2s [ 949.871482] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.374691] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.375147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.375147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.375147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.375338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.375374] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 is going to be created. [ 950.412912] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.412912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.412912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.412912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.413143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.423538] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 in Status: UNINITIALIZED for 2s [ 951.573031] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: SUCCESS [ 951.573031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.573031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.573031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.573031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.573537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.573537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.573537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.573537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.573537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.573707] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.690079] env[65161]: INFO networking_nsxv3.common.synchronization [req-ce0d116b-36f9-4a1a-803d-4172cb6ca012 req-db34d7e1-3832-4557-8f0c-146d463550e6 tempest-ServersTestFqdnHostnames-1875275343 tempest-ServersTestFqdnHostnames-1875275343-project-member] Enqueued Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_members [ 951.690852] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGHEST for action security_group_members [ 951.691960] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38cb053-aec9-4ead-86a8-4aa3f2154903 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.692522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.692626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.692846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.693020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.693135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.693202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.693379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.693438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.693533] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.076187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.076412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.076412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.076685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.076912] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.077121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.077231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.077449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.077617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.077719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.078030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.078030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.078251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.078476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.078717] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.078852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.079045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.079188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.079312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.080494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.080657] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.196088] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.196253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.197144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.197433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.197547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.197770] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.197913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.197953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.198598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.198598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.198598] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 is going to be updated. [ 952.228380] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.228571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.228652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.228866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.229045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.241576] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 in Status: IN_PROGRESS for 2s [ 952.435339] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 in Status: SUCCESS [ 952.436644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.436644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.436644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.436644] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.436644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.436644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.436644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.436644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.436994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.436994] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.584353] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9f4e7d3-15ff-431e-9c10-7ea15b2417ee: rpc.has_security_group_logging(os_id): False [ 952.609259] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.609259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.609259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.609259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.629670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.630119] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.630286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.630409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.630877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.630957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.631303] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.631483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.631610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.631902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.632014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.633103] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.633315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.633378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.633632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.633796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.633986] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee is going to be updated. [ 952.698355] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.698555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.698621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.698819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.698978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.711161] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: IN_PROGRESS for 2s [ 952.939370] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.443611] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c187a3f-ed28-483a-9906-11a9f2cce3f3: rpc.has_security_group_logging(os_id): False [ 953.465537] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.465723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.465805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.466977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.466977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.466977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.466977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.466977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.466977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.467733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.467733] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 is going to be created. [ 953.544415] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.544593] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.544664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.544923] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.545116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.559900] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 in Status: IN_PROGRESS for 2s [ 954.251928] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 in Status: SUCCESS [ 954.252252] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 deletion is rescheduled due to dependency. [ 954.252290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.425323] env[65161]: INFO networking_nsxv3.common.synchronization [req-e7581658-4282-4f90-bbe5-450550b73942 req-0a995c07-04f9-478c-a01f-39008e00bdff tempest-ServersWithSpecificFlavorTestJSON-1681046468 tempest-ServersWithSpecificFlavorTestJSON-1681046468-project-member] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 954.426205] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 954.426660] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.426847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.426944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.427927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.428059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.428162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.428216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.428400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.428528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.428605] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.724594] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: SUCCESS [ 954.725101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.754892] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.755129] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-634" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.755246] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-634" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.755536] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-634" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.755921] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.756099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.756221] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.756509] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.756676] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.756889] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.757010] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.757127] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.757237] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.757350] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.757456] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.757591] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.778844] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.779074] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.779222] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.779399] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-634" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.779717] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-30c5be12-2de6-4e07-90cb-6d409c66fb5d taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.779889] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-30c5be12-2de6-4e07-90cb-6d409c66fb5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.780015] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-30c5be12-2de6-4e07-90cb-6d409c66fb5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.780388] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-30c5be12-2de6-4e07-90cb-6d409c66fb5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.780528] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30c5be12-2de6-4e07-90cb-6d409c66fb5d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.902590] env[65161]: INFO networking_nsxv3.common.synchronization [None req-4d6de562-b4b7-4dfe-b53a-9e6fbc24c0de tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_rules [ 954.903210] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_rules [ 954.903639] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.903765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.903848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.904101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.904185] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.931911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.931911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.931911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.931911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.932192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.932230] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.932353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.932438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.932546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.932676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.932771] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 is going to be updated. [ 954.962116] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.962283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.962325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.962539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.962706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.972083] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: IN_PROGRESS for 2s [ 955.014862] env[65161]: INFO networking_nsxv3.common.synchronization [None req-fc6f46f4-ef4c-49a1-8771-ade99a0ecceb tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_rules [ 955.015398] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_rules [ 955.015757] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.015861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.284817] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.284817] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.284817] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.284817] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.285629] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.285629] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 30c5be12-2de6-4e07-90cb-6d409c66fb5d not found, creating... [ 955.286307] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.286307] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.287127] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.287229] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.287452] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.288017] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.288305] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.288512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.289414] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.289414] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.289414] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 30c5be12-2de6-4e07-90cb-6d409c66fb5d is going to be created. [ 955.330870] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.331306] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.331532] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.331980] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.332533] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.332952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-30c5be12-2de6-4e07-90cb-6d409c66fb5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.428544] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.428544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.428544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.428544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.428544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.428544] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f already deleted. [ 955.428871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.428871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.428925] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.429078] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.596076] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 in Status: SUCCESS [ 955.596400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.951886] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.952096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.952096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.952378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.952519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.952730] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f already deleted. [ 955.952803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.036813] env[65161]: INFO networking_nsxv3.common.synchronization [req-e7581658-4282-4f90-bbe5-450550b73942 req-a7c3b014-d52d-4a67-b419-6fa445291dbf service nova] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_rules [ 956.037118] env[65161]: INFO networking_nsxv3.common.synchronization [req-e7581658-4282-4f90-bbe5-450550b73942 req-a7c3b014-d52d-4a67-b419-6fa445291dbf service nova] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 956.037250] env[65161]: INFO networking_nsxv3.common.synchronization [req-e7581658-4282-4f90-bbe5-450550b73942 req-a7c3b014-d52d-4a67-b419-6fa445291dbf service nova] Enqueued Resource ID: 30c5be12-2de6-4e07-90cb-6d409c66fb5d with Priority: HIGHEST for action port [ 956.037894] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_rules [ 956.038096] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 956.038154] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30c5be12-2de6-4e07-90cb-6d409c66fb5d with Priority: HIGHEST for action port [ 956.038424] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.038552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.038622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.038840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.038933] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.041874] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.042140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.042140] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-30c5be12-2de6-4e07-90cb-6d409c66fb5d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.042310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30c5be12-2de6-4e07-90cb-6d409c66fb5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.042310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30c5be12-2de6-4e07-90cb-6d409c66fb5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.042515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30c5be12-2de6-4e07-90cb-6d409c66fb5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.042587] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30c5be12-2de6-4e07-90cb-6d409c66fb5d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.142845] env[65161]: INFO networking_nsxv3.common.synchronization [req-307a73c3-db5f-4ab9-93fd-ee36ba11cd24 req-b29de426-19a7-404c-8924-5de994a1699a tempest-ServerRescueNegativeTestJSON-1925364810 tempest-ServerRescueNegativeTestJSON-1925364810-project-member] Enqueued Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_members [ 956.143496] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGHEST for action security_group_members [ 956.143819] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24f796e-b77b-42f0-a7c2-ae92228b28c5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.143947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.144082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.144361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.144527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.144669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.144774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.145021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.145160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.145287] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.544441] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.545122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.550465] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30c5be12-2de6-4e07-90cb-6d409c66fb5d with status ACTIVE [ 956.550741] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.550936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.551013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.551279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.551359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.551668] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.551780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.551780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.551926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.552040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.552289] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.552467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.552530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.552867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.552961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.552994] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30c5be12-2de6-4e07-90cb-6d409c66fb5d is going to be updated. [ 956.583337] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.583337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.583476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.583713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.583949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.584192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30c5be12-2de6-4e07-90cb-6d409c66fb5d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.649555] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.649835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.649835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.650073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.673582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.673582] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.673582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.673582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.673976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.673976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.673976] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 is going to be updated. [ 956.731589] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.731692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.731788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.732291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.732533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.745151] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 in Status: IN_PROGRESS for 2s [ 956.991464] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: SUCCESS [ 956.991771] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 deletion is rescheduled due to dependency. [ 956.991985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.992289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.993184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.993184] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.993382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.994817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.995139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.995297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.995464] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.500480] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.002493] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.507275] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.507401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.507483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.507684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.507774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.507876] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 is going to be updated. [ 958.536096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.536277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.536323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.536536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.536684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.546152] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: IN_PROGRESS for 2s [ 958.755369] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 in Status: SUCCESS [ 958.755369] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 deletion is rescheduled due to dependency. [ 958.755369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.237543] env[65161]: INFO networking_nsxv3.common.synchronization [req-9aedaf2e-3739-4ed7-9edf-09bda615ec68 req-63b08e8c-380e-47f8-a18b-009b8595400b tempest-ServersNegativeTestMultiTenantJSON-1167511568 tempest-ServersNegativeTestMultiTenantJSON-1167511568-project-member] Enqueued Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGHEST for action security_group_members [ 959.238795] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGHEST for action security_group_members [ 959.238795] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-28f6a198-5899-42cf-bfcf-d51f32053a44 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.238795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.238795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.239089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.239862] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.240014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.240065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.243019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.244080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.244243] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.620630] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.620923] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-768" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.621075] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-768" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.621455] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-768" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.621730] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.621897] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.622182] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.622442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.622595] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.622898] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.623027] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.623132] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.623237] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.623345] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.623450] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.623579] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.673504] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.673684] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.673839] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.674090] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-768" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.675296] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-095d5e6b-46db-4ba9-9634-a77784b00e87 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.675296] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-095d5e6b-46db-4ba9-9634-a77784b00e87" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.675296] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-095d5e6b-46db-4ba9-9634-a77784b00e87" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.675296] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-095d5e6b-46db-4ba9-9634-a77784b00e87" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.675296] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('095d5e6b-46db-4ba9-9634-a77784b00e87',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.746863] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.747066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.747115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.747324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.747401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.747608] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.747673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.747742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.747899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.747966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.748060] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 already deleted. [ 959.748142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.180339] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.180339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.180339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.180339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.180339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.180339] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 095d5e6b-46db-4ba9-9634-a77784b00e87 not found, creating... [ 960.180339] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.180339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.180339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.180339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.180814] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.180979] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.181266] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.181472] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.181728] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.181919] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.182116] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 095d5e6b-46db-4ba9-9634-a77784b00e87 is going to be created. [ 960.206038] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.206038] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.206038] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.206038] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.206263] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.207154] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-095d5e6b-46db-4ba9-9634-a77784b00e87" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.558699] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: SUCCESS [ 960.558699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.558699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.558699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.558699] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.558699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.558699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.558699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.558699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.558699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.558699] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.889980] env[65161]: INFO networking_nsxv3.common.synchronization [req-9aedaf2e-3739-4ed7-9edf-09bda615ec68 req-fb4c2034-678a-4f6f-b775-870670f64429 service nova] Enqueued Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGHEST for action security_group_rules [ 960.891264] env[65161]: INFO networking_nsxv3.common.synchronization [req-9aedaf2e-3739-4ed7-9edf-09bda615ec68 req-fb4c2034-678a-4f6f-b775-870670f64429 service nova] Enqueued Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGHEST for action security_group_members [ 960.891264] env[65161]: INFO networking_nsxv3.common.synchronization [req-9aedaf2e-3739-4ed7-9edf-09bda615ec68 req-fb4c2034-678a-4f6f-b775-870670f64429 service nova] Enqueued Resource ID: 095d5e6b-46db-4ba9-9634-a77784b00e87 with Priority: HIGHEST for action port [ 960.891264] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGHEST for action security_group_rules [ 960.891264] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGHEST for action security_group_members [ 960.891541] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 095d5e6b-46db-4ba9-9634-a77784b00e87 with Priority: HIGHEST for action port [ 960.891847] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28f6a198-5899-42cf-bfcf-d51f32053a44 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.891956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.892037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.892324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.892409] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.894390] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-28f6a198-5899-42cf-bfcf-d51f32053a44 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.894390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.894390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.894390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.894390] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.896438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.897891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.898159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.898272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.898433] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.899415] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-095d5e6b-46db-4ba9-9634-a77784b00e87 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.899545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-095d5e6b-46db-4ba9-9634-a77784b00e87" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.899616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-095d5e6b-46db-4ba9-9634-a77784b00e87" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.899864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-095d5e6b-46db-4ba9-9634-a77784b00e87" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.899895] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('095d5e6b-46db-4ba9-9634-a77784b00e87',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.062984] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.402835] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.402835] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-28f6a198-5899-42cf-bfcf-d51f32053a44 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.403077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.403112] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 095d5e6b-46db-4ba9-9634-a77784b00e87 with status ACTIVE [ 961.403258] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.403370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.403435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.403665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.403762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.403961] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.404060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.404105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.404513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.404513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.404513] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.404662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.404662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.404769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.404800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.404865] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 095d5e6b-46db-4ba9-9634-a77784b00e87 is going to be updated. [ 961.431900] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.432098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.432145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.432424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.432461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.432630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-095d5e6b-46db-4ba9-9634-a77784b00e87" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.566686] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39: rpc.has_security_group_logging(os_id): False [ 961.585051] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.585051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.585051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.585315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.585418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.585588] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.585684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.585746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.585892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.585975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.586079] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 is going to be updated. [ 961.656058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.656058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.656058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.656226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.657052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.669634] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: IN_PROGRESS for 2s [ 962.051151] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.409480] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.409656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.409728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.409937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.410037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.410325] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 is going to be created. [ 962.437513] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.437513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.437513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.437513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.437513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.448072] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 in Status: UNINITIALIZED for 2s [ 963.359692] env[65161]: INFO networking_nsxv3.common.synchronization [req-31d77ae1-6dd6-4931-a7c5-2cc6141fa6d6 req-2b79e171-38cb-4129-a71c-974af71b658c tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 963.360229] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 963.360532] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.360815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.360815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.360977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.361151] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.361249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.361311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.361454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.361586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.361627] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.683235] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: SUCCESS [ 963.683235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.863708] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.863961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.864038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.864219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.864313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.864528] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.864630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.864898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.864898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.865036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.865036] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be updated. [ 963.892175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.892386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.893035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.893035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.893035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.905799] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: IN_PROGRESS for 2s [ 964.459342] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 in Status: SUCCESS [ 964.461025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.461025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.461025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.461025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.461025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.461025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.461025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.461025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.461025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.461025] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.965306] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-28f6a198-5899-42cf-bfcf-d51f32053a44 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.965306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.965306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.966055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.966055] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.966055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.966055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.966055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.966055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.967016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.967016] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-28f6a198-5899-42cf-bfcf-d51f32053a44 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.967016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.967016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.967016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.967016] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.967016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.967016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.967323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.967323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.967323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.967428] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.020282] env[65161]: INFO networking_nsxv3.common.synchronization [None req-13ec1a88-73b3-4d5c-a9e5-937d66bc365e tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 97938808-fe1b-4db1-861e-64390d406339 with Priority: HIGHEST for action security_group_rules [ 965.020966] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97938808-fe1b-4db1-861e-64390d406339 with Priority: HIGHEST for action security_group_rules [ 965.021335] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97938808-fe1b-4db1-861e-64390d406339 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.022095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97938808-fe1b-4db1-861e-64390d406339" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.022095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97938808-fe1b-4db1-861e-64390d406339" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.022095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97938808-fe1b-4db1-861e-64390d406339" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.022095] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97938808-fe1b-4db1-861e-64390d406339',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.175241] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c8d8e578-adcd-46d1-a405-e95f1a252456 tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 97938808-fe1b-4db1-861e-64390d406339 with Priority: HIGHEST for action security_group_rules [ 965.176400] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97938808-fe1b-4db1-861e-64390d406339 with Priority: HIGHEST for action security_group_rules [ 965.176698] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97938808-fe1b-4db1-861e-64390d406339 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.176799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97938808-fe1b-4db1-861e-64390d406339" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.470818] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28f6a198-5899-42cf-bfcf-d51f32053a44: rpc.has_security_group_logging(os_id): False [ 965.487034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.487201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.487327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.487528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.487611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.487805] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.488318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.488318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.488318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.488318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.488432] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.493179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.493179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.493179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.493179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.493179] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.493179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.493179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.493179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.493179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.493179] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 is going to be created. [ 965.548659] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.548852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.548852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.549106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.549205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.549288] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97938808-fe1b-4db1-861e-64390d406339 already deleted. [ 965.549380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97938808-fe1b-4db1-861e-64390d406339" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.549511] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97938808-fe1b-4db1-861e-64390d406339" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.549664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97938808-fe1b-4db1-861e-64390d406339" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.549756] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97938808-fe1b-4db1-861e-64390d406339',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.590059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.590059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.590059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.590059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.590059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.605867] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 in Status: IN_PROGRESS for 2s [ 965.919056] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: SUCCESS [ 965.919575] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 deletion is rescheduled due to dependency. [ 965.919575] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.072326] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.072326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.072326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.073495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.073495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.073495] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97938808-fe1b-4db1-861e-64390d406339 already deleted. [ 966.073495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97938808-fe1b-4db1-861e-64390d406339" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.624401] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 in Status: SUCCESS [ 967.624401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.135609] env[65161]: INFO networking_nsxv3.common.synchronization [None req-e7439c1a-8d3b-4d98-a56a-51841c5c589f None None] Enqueued Resource ID: 535ca0c0-67ab-4ecb-9af8-11404e49b4c7 with Priority: HIGHEST for action port [ 968.136388] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 535ca0c0-67ab-4ecb-9af8-11404e49b4c7 with Priority: HIGHEST for action port [ 968.136484] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-535ca0c0-67ab-4ecb-9af8-11404e49b4c7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.136745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-535ca0c0-67ab-4ecb-9af8-11404e49b4c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.136745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-535ca0c0-67ab-4ecb-9af8-11404e49b4c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.137031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-535ca0c0-67ab-4ecb-9af8-11404e49b4c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.137171] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('535ca0c0-67ab-4ecb-9af8-11404e49b4c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.639827] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 535ca0c0-67ab-4ecb-9af8-11404e49b4c7 [ 968.642143] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.642143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.642143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.642143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.642143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.642143] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:535ca0c0-67ab-4ecb-9af8-11404e49b4c7 already deleted. [ 968.642143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-535ca0c0-67ab-4ecb-9af8-11404e49b4c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.674644] env[65161]: INFO networking_nsxv3.common.synchronization [req-77de3308-385b-4ca4-9b8b-75f97497bbdd req-e423bf74-5cf4-4094-a678-16b985c3fc5c tempest-ServersTestJSON-592902756 tempest-ServersTestJSON-592902756-project-member] Enqueued Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_members [ 968.676172] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGHEST for action security_group_members [ 968.676472] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-70c8e546-9b00-4441-97c1-cb8beb5cab1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.676639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.676733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.677015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.677221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.677390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.677451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.678413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.678413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.678413] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.029376] env[65161]: INFO networking_nsxv3.common.synchronization [req-fbf24832-024f-4b59-9c31-278fcab84bb2 req-95bdb2be-0686-4a07-8e29-1bacda7dcd3c tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 969.029376] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 969.029376] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.029376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.029376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.029376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.029376] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.029376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.029376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.029376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.029376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.034873] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.180859] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.180859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.180859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.182367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.182367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.186017] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.186017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.186017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.186017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.186017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.186017] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f is going to be updated. [ 969.219540] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.219722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.219813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.220937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.221121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.234258] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f in Status: IN_PROGRESS for 2s [ 969.536326] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.536477] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.536609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.536759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.536846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.537044] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.541273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.541273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.541273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.541273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.541273] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 969.572113] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.572268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.572422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.572807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.572807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.584490] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 970.419548] env[65161]: INFO networking_nsxv3.common.synchronization [None req-a420347b-a3c1-404f-8094-207370dec3ef None None] Enqueued Resource ID: fc7c013b-9f5f-471a-b757-b9edf3bd991a with Priority: HIGHEST for action port [ 970.420194] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc7c013b-9f5f-471a-b757-b9edf3bd991a with Priority: HIGHEST for action port [ 970.420297] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc7c013b-9f5f-471a-b757-b9edf3bd991a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.420370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc7c013b-9f5f-471a-b757-b9edf3bd991a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.420406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc7c013b-9f5f-471a-b757-b9edf3bd991a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.420910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc7c013b-9f5f-471a-b757-b9edf3bd991a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.420910] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7c013b-9f5f-471a-b757-b9edf3bd991a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.923262] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc7c013b-9f5f-471a-b757-b9edf3bd991a [ 970.923567] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.923795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.924181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.924433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.924531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.924634] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc7c013b-9f5f-471a-b757-b9edf3bd991a already deleted. [ 970.924717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc7c013b-9f5f-471a-b757-b9edf3bd991a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.246072] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f in Status: SUCCESS [ 971.246072] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f deletion is rescheduled due to dependency. [ 971.246072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.594626] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 971.595089] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 971.595188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.467287] env[65161]: INFO networking_nsxv3.common.synchronization [None req-6a9e8bba-2035-4fba-84c7-cabe3f2e7257 None None] Enqueued Resource ID: fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2 with Priority: HIGHEST for action port [ 972.467832] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2 with Priority: HIGHEST for action port [ 972.468238] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.468379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.468475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.468810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.468927] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.972435] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2 [ 972.972752] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.972752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.972752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.972992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.973099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.973197] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2 already deleted. [ 972.973279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe8bdf5e-0e70-4d33-81f0-61c287ed3fd2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.911657] env[65161]: INFO networking_nsxv3.common.synchronization [None req-0688d0ce-0c51-4d06-9d50-154424931086 None None] Enqueued Resource ID: 326b6580-6abf-4f29-bdca-3c8ab89aee83 with Priority: HIGHEST for action port [ 973.914233] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326b6580-6abf-4f29-bdca-3c8ab89aee83 with Priority: HIGHEST for action port [ 973.914233] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-326b6580-6abf-4f29-bdca-3c8ab89aee83 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.914233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-326b6580-6abf-4f29-bdca-3c8ab89aee83" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.914233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-326b6580-6abf-4f29-bdca-3c8ab89aee83" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.914233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-326b6580-6abf-4f29-bdca-3c8ab89aee83" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.914233] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('326b6580-6abf-4f29-bdca-3c8ab89aee83',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.416963] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 326b6580-6abf-4f29-bdca-3c8ab89aee83 [ 974.417338] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.417338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.417459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.417633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.417714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.417814] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:326b6580-6abf-4f29-bdca-3c8ab89aee83 already deleted. [ 974.418061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-326b6580-6abf-4f29-bdca-3c8ab89aee83" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.558162] env[65161]: INFO networking_nsxv3.common.synchronization [req-fc7536fc-5a9c-482e-9580-4ac49c3bde45 req-e8560c1e-b8db-436b-9927-d1384021ffee tempest-ServersNegativeTestMultiTenantJSON-1167511568 tempest-ServersNegativeTestMultiTenantJSON-1167511568-project-member] Enqueued Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGHEST for action security_group_members [ 974.558715] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGHEST for action security_group_members [ 974.559245] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-28f6a198-5899-42cf-bfcf-d51f32053a44 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.559245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.559245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.559495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.559544] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.559632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.563450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.563640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.563735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.563865] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.928341] env[65161]: INFO networking_nsxv3.common.synchronization [None req-6c8628fb-8354-482e-9603-4d83fae1250d None None] Enqueued Resource ID: 818868b4-ef7b-4bb1-93b5-6ebada23d891 with Priority: HIGHEST for action port [ 974.928607] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 818868b4-ef7b-4bb1-93b5-6ebada23d891 with Priority: HIGHEST for action port [ 974.929198] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-818868b4-ef7b-4bb1-93b5-6ebada23d891 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.929335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-818868b4-ef7b-4bb1-93b5-6ebada23d891" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.929372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-818868b4-ef7b-4bb1-93b5-6ebada23d891" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.929619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-818868b4-ef7b-4bb1-93b5-6ebada23d891" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.929747] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('818868b4-ef7b-4bb1-93b5-6ebada23d891',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.066867] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.067047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.067047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.067295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.067348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.067532] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.067598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.067664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.068274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.068274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.068274] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 is going to be updated. [ 975.102282] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.102282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.102282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.102524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.102786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.114116] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 in Status: IN_PROGRESS for 2s [ 975.433160] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 818868b4-ef7b-4bb1-93b5-6ebada23d891 [ 975.433527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.433594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.433724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.433949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.434098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.434176] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:818868b4-ef7b-4bb1-93b5-6ebada23d891 already deleted. [ 975.434268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-818868b4-ef7b-4bb1-93b5-6ebada23d891" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.473046] env[65161]: INFO networking_nsxv3.common.synchronization [None req-e5f18609-be68-4b3e-ab0a-8ad451922584 None None] Enqueued Resource ID: b6348416-c7e8-4431-94c0-0f0f2355c9f9 with Priority: HIGHEST for action port [ 976.473528] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6348416-c7e8-4431-94c0-0f0f2355c9f9 with Priority: HIGHEST for action port [ 976.473793] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6348416-c7e8-4431-94c0-0f0f2355c9f9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.473917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6348416-c7e8-4431-94c0-0f0f2355c9f9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.473986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6348416-c7e8-4431-94c0-0f0f2355c9f9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.474261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6348416-c7e8-4431-94c0-0f0f2355c9f9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.474348] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6348416-c7e8-4431-94c0-0f0f2355c9f9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.977080] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6348416-c7e8-4431-94c0-0f0f2355c9f9 [ 976.978111] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.978111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.978111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.978111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.978111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.978111] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6348416-c7e8-4431-94c0-0f0f2355c9f9 already deleted. [ 976.978111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6348416-c7e8-4431-94c0-0f0f2355c9f9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.126717] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 in Status: SUCCESS [ 977.127637] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 deletion is rescheduled due to dependency. [ 977.127637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.463277] env[65161]: INFO networking_nsxv3.common.synchronization [req-88a10750-85a7-42d1-a9e4-8f3b73232ec5 req-e872a39f-d0ea-496e-98f4-06e1eb6141d3 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 981.464169] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 981.464262] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.464419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.464505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.464804] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.466463] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.466463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.467753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.467959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.468072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.468182] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.792492] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.792625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.793252] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.793252] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.793691] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.793886] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.794015] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.794242] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.794387] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.794595] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.794709] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.794821] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.794943] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.795064] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.795172] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.795304] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.816858] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.817045] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 981.817188] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.817360] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.817669] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-94cd0ccd-dbef-4797-8446-6e9b8061672c taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.817926] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-94cd0ccd-dbef-4797-8446-6e9b8061672c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.817995] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-94cd0ccd-dbef-4797-8446-6e9b8061672c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.818365] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-94cd0ccd-dbef-4797-8446-6e9b8061672c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.818510] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cd0ccd-dbef-4797-8446-6e9b8061672c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.971070] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.971070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.971070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.971520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.972568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.972568] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.972568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.972568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.972568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.972568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.972568] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be already deleted. [ 981.972568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.320783] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.321288] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.321288] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.321698] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.321698] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.321790] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 94cd0ccd-dbef-4797-8446-6e9b8061672c not found, creating... [ 982.322784] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.322784] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.322784] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.322784] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.322784] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.323109] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.323109] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.323217] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.323404] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.323539] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.323679] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 94cd0ccd-dbef-4797-8446-6e9b8061672c is going to be created. [ 982.344223] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.344453] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.344582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.344851] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.345759] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.345759] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-94cd0ccd-dbef-4797-8446-6e9b8061672c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.054023] env[65161]: INFO networking_nsxv3.common.synchronization [req-88a10750-85a7-42d1-a9e4-8f3b73232ec5 req-9b3cf058-e205-4c68-9a49-16f9d73244db service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 983.054384] env[65161]: INFO networking_nsxv3.common.synchronization [req-88a10750-85a7-42d1-a9e4-8f3b73232ec5 req-9b3cf058-e205-4c68-9a49-16f9d73244db service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 983.054648] env[65161]: INFO networking_nsxv3.common.synchronization [req-88a10750-85a7-42d1-a9e4-8f3b73232ec5 req-9b3cf058-e205-4c68-9a49-16f9d73244db service nova] Enqueued Resource ID: 94cd0ccd-dbef-4797-8446-6e9b8061672c with Priority: HIGHEST for action port [ 983.055440] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 983.055675] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 983.055856] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cd0ccd-dbef-4797-8446-6e9b8061672c with Priority: HIGHEST for action port [ 983.056371] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.056535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.056645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.057025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.057160] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.058453] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.058660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.058886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.059248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.060193] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.060193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.060193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.060193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.060193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.060193] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.061401] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-94cd0ccd-dbef-4797-8446-6e9b8061672c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.061512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94cd0ccd-dbef-4797-8446-6e9b8061672c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.061558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94cd0ccd-dbef-4797-8446-6e9b8061672c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.061834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94cd0ccd-dbef-4797-8446-6e9b8061672c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.062020] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cd0ccd-dbef-4797-8446-6e9b8061672c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.565029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.565029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.565029] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.565752] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94cd0ccd-dbef-4797-8446-6e9b8061672c with status ACTIVE [ 983.565926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.566567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.566567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.566567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.566567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.566567] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.566869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.566869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.566869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.566963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.567107] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.567209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.567299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.567400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.567474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.567562] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94cd0ccd-dbef-4797-8446-6e9b8061672c is going to be updated. [ 983.589490] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.589654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.589717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.589922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.590080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.590237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94cd0ccd-dbef-4797-8446-6e9b8061672c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.983602] env[65161]: INFO networking_nsxv3.common.synchronization [req-5de1bc46-0817-4956-a2fe-a12326b87d7c req-8f3445c0-7118-4875-acda-26ab5ef17b51 tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 983.984254] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 983.984680] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.984994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.984994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.985134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.985757] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.985757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.985757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.985757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.985757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.985757] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.069436] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.390531] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.390727] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.390934] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.395018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.395018] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.395018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.395018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.395018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.395018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.395018] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.395018] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.395018] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.395018] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.395018] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.395018] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.395018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.414059] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.414809] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.415017] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.415209] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-569" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.415534] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.415713] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.415835] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.416177] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.416320] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.491975] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.492207] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.492262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.492515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.492640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.492953] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.493058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.493120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.493251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.493329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.493447] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 984.521065] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.521461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.521461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.521461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.521665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.531375] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 984.547663] env[65161]: INFO networking_nsxv3.common.synchronization [None req-01030495-9537-4a6a-8720-738d3993203c tempest-ImagesOneServerNegativeTestJSON-1819154006 tempest-ImagesOneServerNegativeTestJSON-1819154006-project-member] Enqueued Resource ID: 151a470c-2d19-4453-9c35-ecf6f279af8a with Priority: HIGHEST for action security_group_rules [ 984.548229] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 151a470c-2d19-4453-9c35-ecf6f279af8a with Priority: HIGHEST for action security_group_rules [ 984.548919] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-151a470c-2d19-4453-9c35-ecf6f279af8a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.548919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-151a470c-2d19-4453-9c35-ecf6f279af8a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.548919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-151a470c-2d19-4453-9c35-ecf6f279af8a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.549174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-151a470c-2d19-4453-9c35-ecf6f279af8a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.549174] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('151a470c-2d19-4453-9c35-ecf6f279af8a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.575089] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.575252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.575314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.575509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.575595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.575691] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be created. [ 984.600300] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.600475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.600526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.600735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.600895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.613249] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: UNINITIALIZED for 2s [ 984.748598] env[65161]: INFO networking_nsxv3.common.synchronization [None req-4033a20a-8a66-4298-a8e7-99ffda04b38b tempest-ImagesOneServerNegativeTestJSON-1819154006 tempest-ImagesOneServerNegativeTestJSON-1819154006-project-member] Enqueued Resource ID: 151a470c-2d19-4453-9c35-ecf6f279af8a with Priority: HIGHEST for action security_group_rules [ 984.749074] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 151a470c-2d19-4453-9c35-ecf6f279af8a with Priority: HIGHEST for action security_group_rules [ 984.749389] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-151a470c-2d19-4453-9c35-ecf6f279af8a taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.749546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-151a470c-2d19-4453-9c35-ecf6f279af8a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.919701] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.919946] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.920087] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.920366] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.920549] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.920710] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8 not found, creating... [ 984.921014] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.921187] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.921305] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.921522] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.921659] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.921938] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.922104] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.922221] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.922424] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.922556] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.922690] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8 is going to be created. [ 984.944522] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.944725] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.944852] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.945166] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.945378] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.945598] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.081539] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.081797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.081797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.082313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.082313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.082313] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 151a470c-2d19-4453-9c35-ecf6f279af8a already deleted. [ 985.082541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-151a470c-2d19-4453-9c35-ecf6f279af8a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.083011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-151a470c-2d19-4453-9c35-ecf6f279af8a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.083180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-151a470c-2d19-4453-9c35-ecf6f279af8a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.083345] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('151a470c-2d19-4453-9c35-ecf6f279af8a',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.608761] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.608927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.609013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.609245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.609336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.609433] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 151a470c-2d19-4453-9c35-ecf6f279af8a already deleted. [ 985.609517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-151a470c-2d19-4453-9c35-ecf6f279af8a" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.668441] env[65161]: INFO networking_nsxv3.common.synchronization [req-5de1bc46-0817-4956-a2fe-a12326b87d7c req-c8e67a31-8409-4697-afc5-86d9b051e0d5 service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 985.668441] env[65161]: INFO networking_nsxv3.common.synchronization [req-5de1bc46-0817-4956-a2fe-a12326b87d7c req-c8e67a31-8409-4697-afc5-86d9b051e0d5 service nova] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 985.668441] env[65161]: INFO networking_nsxv3.common.synchronization [req-5de1bc46-0817-4956-a2fe-a12326b87d7c req-c8e67a31-8409-4697-afc5-86d9b051e0d5 service nova] Enqueued Resource ID: d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8 with Priority: HIGHEST for action port [ 985.668441] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_rules [ 985.668441] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 985.668441] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8 with Priority: HIGHEST for action port [ 985.671973] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.671973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.671973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.671973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.671973] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.671973] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.671973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.671973] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.671973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.671973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.671973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.671973] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.171659] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.172011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.174234] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8 with status ACTIVE [ 986.174881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.174881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.174881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.174881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.174881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.175164] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.175164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.175639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.175639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.175639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.175639] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.175892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.175892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.175892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.176423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.176423] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8 is going to be updated. [ 986.197698] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.197698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.197698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.198124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.198124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.198262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8a78c79-32e4-4848-8bc6-3bd8f8c4bbb8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.479933] env[65161]: INFO networking_nsxv3.common.synchronization [req-5b89859d-564b-4242-903c-aaeb8179fd94 req-a2d426f7-0bfd-4058-bf79-b0a41edf6c4f tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 986.481035] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 986.481035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.481035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.481238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.481307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.481467] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.481570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.481631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.481784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.481870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.481961] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.542062] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 986.542568] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b deletion is rescheduled due to dependency. [ 986.542568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.542568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.542989] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.542989] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.543212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.543212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.544152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.544152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.544152] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.627019] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 986.627019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.627019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.627019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.627019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.627019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.627019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.627019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.627019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.627019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.627019] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.839777] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.839972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.840115] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.840422] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.840618] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.840800] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.840925] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.841155] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.841302] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.841511] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.841625] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.841733] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.841861] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.842217] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.842217] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.842319] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.862687] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.862895] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.863091] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.863266] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.863577] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-76f62674-d06b-4896-928b-8170a9a623fa taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.863770] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-76f62674-d06b-4896-928b-8170a9a623fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.863923] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-76f62674-d06b-4896-928b-8170a9a623fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.864218] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-76f62674-d06b-4896-928b-8170a9a623fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.864357] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76f62674-d06b-4896-928b-8170a9a623fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.984787] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.048221] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.129884] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.130177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.130255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.130473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.130652] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.130766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.130848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.131021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.131108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.131197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.131342] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.131449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.131492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.131624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.131758] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.131849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.131904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.132054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.132135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.132215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.132331] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.366620] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.366950] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.366996] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.367409] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.367559] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.367715] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 76f62674-d06b-4896-928b-8170a9a623fa not found, creating... [ 987.368024] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.368218] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.368468] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.368725] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.368868] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.369168] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.369326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.369939] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.370190] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.370728] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.370917] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 76f62674-d06b-4896-928b-8170a9a623fa is going to be created. [ 987.391481] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.391760] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.391845] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.392262] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.392531] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.392788] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-76f62674-d06b-4896-928b-8170a9a623fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.486162] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.552138] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.636658] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ad3588-f61e-418d-9a8e-c65add44c1be: rpc.has_security_group_logging(os_id): False [ 987.656028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.656028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.656028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.656028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.656774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.656990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.657326] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.657705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.657888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.658142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.658365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.658602] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be created. [ 987.726779] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.726779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.726779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.726779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.726779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.740547] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 987.990743] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.990743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.990743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.990743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.990743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.990743] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 988.018932] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.019153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.019153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.019361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.019487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.030362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 988.053713] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.053891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.053945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.054182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.054259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.054356] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 988.088159] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.088374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.088374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.088606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.088763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.098703] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 988.104971] env[65161]: INFO networking_nsxv3.common.synchronization [req-5b89859d-564b-4242-903c-aaeb8179fd94 req-47f38e4c-4e94-4095-825e-8a3814587208 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 988.104971] env[65161]: INFO networking_nsxv3.common.synchronization [req-5b89859d-564b-4242-903c-aaeb8179fd94 req-47f38e4c-4e94-4095-825e-8a3814587208 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 988.105715] env[65161]: INFO networking_nsxv3.common.synchronization [req-5b89859d-564b-4242-903c-aaeb8179fd94 req-47f38e4c-4e94-4095-825e-8a3814587208 service nova] Enqueued Resource ID: 76f62674-d06b-4896-928b-8170a9a623fa with Priority: HIGHEST for action port [ 988.106844] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 988.107020] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 988.107104] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76f62674-d06b-4896-928b-8170a9a623fa with Priority: HIGHEST for action port [ 988.107378] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.107497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.107570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.107750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.107829] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.108683] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.108782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.108968] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-76f62674-d06b-4896-928b-8170a9a623fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.109082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76f62674-d06b-4896-928b-8170a9a623fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.109138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76f62674-d06b-4896-928b-8170a9a623fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.109301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76f62674-d06b-4896-928b-8170a9a623fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.109393] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76f62674-d06b-4896-928b-8170a9a623fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.611432] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.611966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.611966] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76f62674-d06b-4896-928b-8170a9a623fa with status ACTIVE [ 988.613027] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.613027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.613027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.613027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.613366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.613641] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.614564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.614564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.614564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.614564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.614564] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.614844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.614844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.614989] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.615149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.615251] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76f62674-d06b-4896-928b-8170a9a623fa is going to be updated. [ 988.645635] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.645839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.645887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.646076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.646222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.646383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76f62674-d06b-4896-928b-8170a9a623fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.758475] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 989.758807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.041413] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 990.041530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.041698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.041921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.042134] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.042256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.042320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.042483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.042565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.042661] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.109703] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 990.109813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.109935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.110165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.110374] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.110491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.110568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.110778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.110881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.111027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.111104] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.545213] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.613730] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.613919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.614009] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.614311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.614407] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.614705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.614705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.614705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.614813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.614876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.615029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.615122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.615179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.615318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.615465] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.615554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.615612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.615823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.615823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.615898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.616069] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.048026] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.121920] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68ff1a7f-59cd-4081-9af0-9322734ba92b: rpc.has_security_group_logging(os_id): False [ 991.140532] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.140656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.140706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.141037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.141072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.141307] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.141369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.141458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.141618] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.141694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.141934] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.142099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.142146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.142289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.142360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.142535] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.142636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.142744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.142968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.143071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.143235] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 991.206500] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.206711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.206711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.206996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.207177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.221825] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 991.550739] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.550739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.550739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.550739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.550997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.550997] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 991.580791] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.580966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.581050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.581264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.581414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.593324] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 991.599774] env[65161]: INFO networking_nsxv3.common.synchronization [req-a0c8de4e-c27a-4033-aeaa-be236b68d75f req-07abcddd-bb66-4d96-a8d0-c97abf5e5d42 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_members [ 991.601622] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_members [ 991.601622] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.601622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.601622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.601622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.601622] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.601622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.601622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.601622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.601997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.601997] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.976426] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.976642] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.976781] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.977573] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.977789] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.977956] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.978105] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.978338] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.978485] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.978710] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.978825] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.978950] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.979075] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.979266] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.979654] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.979654] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.000249] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.000993] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.000993] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.000993] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.001156] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.001281] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.001394] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.001716] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.001858] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef2e3ec-f03c-460c-80ed-bade1491bc4c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.103632] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.104736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.104736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.104898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.104955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.105701] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.105701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.105701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.105701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.105701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.106017] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f already deleted. [ 992.106017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.508376] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.509932] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.509932] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.510166] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.510248] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.510347] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 2ef2e3ec-f03c-460c-80ed-bade1491bc4c not found, creating... [ 992.510635] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.510830] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.510930] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.512232] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.512661] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.513056] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.513176] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.513422] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.513519] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.513745] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.513881] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 2ef2e3ec-f03c-460c-80ed-bade1491bc4c is going to be created. [ 992.536089] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.536322] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.536481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.536770] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.537268] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.537268] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.061903] env[65161]: INFO networking_nsxv3.common.synchronization [None req-e62cb72c-ed7d-4d99-83e1-7064c5119045 tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_rules [ 993.062440] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_rules [ 993.063719] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d592aa9d-8cc0-42f6-959d-30654012ec4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.063719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.064543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.064894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.065041] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.237175] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 993.237651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.278557] env[65161]: INFO networking_nsxv3.common.synchronization [None req-a7b54218-88f2-4040-9cdc-d071109e7965 tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_rules [ 993.279051] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_rules [ 993.279355] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d592aa9d-8cc0-42f6-959d-30654012ec4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.279459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.289612] env[65161]: INFO networking_nsxv3.common.synchronization [req-a0c8de4e-c27a-4033-aeaa-be236b68d75f req-4444cebc-51e3-4e72-b3fc-e64a3182009b service nova] Enqueued Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_rules [ 993.289789] env[65161]: INFO networking_nsxv3.common.synchronization [req-a0c8de4e-c27a-4033-aeaa-be236b68d75f req-4444cebc-51e3-4e72-b3fc-e64a3182009b service nova] Enqueued Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_members [ 993.289927] env[65161]: INFO networking_nsxv3.common.synchronization [req-a0c8de4e-c27a-4033-aeaa-be236b68d75f req-4444cebc-51e3-4e72-b3fc-e64a3182009b service nova] Enqueued Resource ID: 2ef2e3ec-f03c-460c-80ed-bade1491bc4c with Priority: HIGHEST for action port [ 993.290153] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_rules [ 993.290286] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_members [ 993.290612] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef2e3ec-f03c-460c-80ed-bade1491bc4c with Priority: HIGHEST for action port [ 993.291118] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.291118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.291118] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.291296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.291379] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.292994] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.292994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.292994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.292994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.292994] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.292994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.292994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.292994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.293521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.293521] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.294431] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.294431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.294431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.294431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.294431] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ef2e3ec-f03c-460c-80ed-bade1491bc4c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.589875] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.590271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.590271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.590415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.590539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.590687] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d592aa9d-8cc0-42f6-959d-30654012ec4e already deleted. [ 993.590869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.591075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.591302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.591418] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.602245] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 993.602598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.602673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.602952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.603180] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.603313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.603365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.603522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.603603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.603692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.603783] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.606957] env[65161]: INFO networking_nsxv3.common.synchronization [req-5955e72d-5e6a-44f9-8add-5d365ffd9a38 req-d001847f-6736-4c0b-b95e-7c222eaccd26 tempest-AttachVolumeTestJSON-1674268260 tempest-AttachVolumeTestJSON-1674268260-project-member] Enqueued Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_members [ 993.609797] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb437f4e-1421-44f7-a301-63abddb16aa0 with Priority: HIGHEST for action security_group_members [ 993.610628] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb437f4e-1421-44f7-a301-63abddb16aa0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.611432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.611552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.611788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.612317] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.614136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.614234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.614371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.614463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.614561] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb437f4e-1421-44f7-a301-63abddb16aa0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.796361] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.797585] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.797693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.801988] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ef2e3ec-f03c-460c-80ed-bade1491bc4c with status ACTIVE [ 993.802244] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.802377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.802447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.802710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.802877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.803102] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.803201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.804156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.804156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.804156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.804156] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.804156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.804156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.804156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.804595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.804595] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ef2e3ec-f03c-460c-80ed-bade1491bc4c is going to be updated. [ 993.833251] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.833382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.833530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.833689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.833867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.833982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ef2e3ec-f03c-460c-80ed-bade1491bc4c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.111569] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.111569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.111569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.111569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.111569] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.111569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.111569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.112052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.112052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.112052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.112152] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.112232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.112290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.112513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.112665] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.113496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.113496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.113496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.113496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.113496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.113496] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.115217] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.115860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.115860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.115860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.115860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.115860] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d592aa9d-8cc0-42f6-959d-30654012ec4e already deleted. [ 994.116116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.117043] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.117043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.117043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.117043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.140262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.140567] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.140710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.140801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.140966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.141064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.141154] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb437f4e-1421-44f7-a301-63abddb16aa0 is going to be updated. [ 994.168217] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.168356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.168443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.168638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.168779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.178210] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb437f4e-1421-44f7-a301-63abddb16aa0 in Status: IN_PROGRESS for 2s [ 994.248120] env[65161]: INFO networking_nsxv3.common.synchronization [req-ea7ec871-714a-4f39-9511-8c20f1a0224f req-e0658189-a217-4421-9529-e0d15c3444eb tempest-ServerRescueNegativeTestJSON-1925364810 tempest-ServerRescueNegativeTestJSON-1925364810-project-member] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 994.249443] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 994.249443] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.249617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.249617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.249793] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.249951] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.250124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.250201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.250358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.250444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.250536] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.299168] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.619260] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caaaa94-1988-4a64-baf8-2e9ad4c3a553: rpc.has_security_group_logging(os_id): False [ 994.641932] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.642113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.642113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.642877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.642877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.643031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.643031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.643120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.643672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.643672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.643672] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.643672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.643672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.643950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.643950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.644114] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.644208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.644271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.644411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.644486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.644568] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 994.716371] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.716574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.716574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.716794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.716940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.731583] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 994.755164] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.803085] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.803293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.803336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.803522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.803611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.803709] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f is going to be created. [ 994.828515] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.828649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.828722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.828939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.829120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.841060] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f in Status: UNINITIALIZED for 2s [ 995.178298] env[65161]: INFO networking_nsxv3.common.synchronization [req-45c3ec8e-d94a-49ca-a0aa-b46289a7894b req-b0891463-b98a-4035-a001-173768ab2223 tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 995.180729] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 995.181088] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.181231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.181299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.181505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.181660] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.181749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.181835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.182022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.182138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.182232] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.257783] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.685610] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.688806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.688806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.688806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.688806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.688806] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.688806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.688806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.688806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.688806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.688806] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 995.731073] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.731073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.731073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.731073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.731073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.742405] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 995.763186] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.763186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.763186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.763186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.763186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.763186] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d is going to be updated. [ 995.791173] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.791561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.791733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.792150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.793513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.811464] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: IN_PROGRESS for 2s [ 996.192663] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb437f4e-1421-44f7-a301-63abddb16aa0 in Status: SUCCESS [ 996.192894] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb437f4e-1421-44f7-a301-63abddb16aa0 deletion is rescheduled due to dependency. [ 996.193046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb437f4e-1421-44f7-a301-63abddb16aa0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.416644] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.416937] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.417051] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.417344] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.417631] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.417820] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.417966] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.418255] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.418423] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.420995] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.421207] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.421356] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.421494] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.422111] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.422281] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.422446] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.444952] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.444952] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.445191] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.445496] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.446523] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.446523] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.449051] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.449051] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.449051] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ceb2dd-d36f-487f-a6af-4cddacfcc5ec',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.747044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 996.747286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.851326] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f in Status: SUCCESS [ 996.851563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.851737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.851958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.852169] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.852291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.852384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.852506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.852582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.852664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.852742] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.950455] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.950727] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.950888] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.951177] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.951350] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.951494] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 91ceb2dd-d36f-487f-a6af-4cddacfcc5ec not found, creating... [ 996.951754] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.951969] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.952162] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.952452] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.952650] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.953190] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.953419] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.953594] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.953870] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.954073] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.954278] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 91ceb2dd-d36f-487f-a6af-4cddacfcc5ec is going to be created. [ 996.976667] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.976667] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.976667] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.976667] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.976667] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.977158] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.355252] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.695290] env[65161]: INFO networking_nsxv3.common.synchronization [req-45c3ec8e-d94a-49ca-a0aa-b46289a7894b req-f860ebb7-3b8b-4a4c-8d0a-14c2f6791cc6 service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 997.695562] env[65161]: INFO networking_nsxv3.common.synchronization [req-45c3ec8e-d94a-49ca-a0aa-b46289a7894b req-f860ebb7-3b8b-4a4c-8d0a-14c2f6791cc6 service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 997.695615] env[65161]: INFO networking_nsxv3.common.synchronization [req-45c3ec8e-d94a-49ca-a0aa-b46289a7894b req-f860ebb7-3b8b-4a4c-8d0a-14c2f6791cc6 service nova] Enqueued Resource ID: 91ceb2dd-d36f-487f-a6af-4cddacfcc5ec with Priority: HIGHEST for action port [ 997.696160] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 997.696328] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 997.696453] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91ceb2dd-d36f-487f-a6af-4cddacfcc5ec with Priority: HIGHEST for action port [ 997.696766] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.697178] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.697279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.697509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.697649] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.699405] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.699405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.699405] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.699405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.699405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.699405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.699405] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ceb2dd-d36f-487f-a6af-4cddacfcc5ec',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.753707] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 997.754965] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 997.756490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.756490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.756490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.756490] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.756490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.756490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.756490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.756490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.756490] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.824044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: SUCCESS [ 997.824281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.858720] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f: rpc.has_security_group_logging(os_id): False [ 997.877411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.877559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.877633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.878706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.878706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.878706] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.878706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.878706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.878706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.878706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.878706] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f is going to be created. [ 997.940637] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.940849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.940922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.941156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.941336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.956692] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f in Status: IN_PROGRESS for 2s [ 998.024182] env[65161]: INFO networking_nsxv3.common.synchronization [req-12fb90c9-2e88-4fda-80d2-2a2223bce36c req-db869693-8cc7-465b-ae8e-179367fe6f38 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 998.024182] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 998.024182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.024182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.024182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.024182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.025138] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.025439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.025607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.025894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.026119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.026336] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.208630] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.209041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.209041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.209339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.209447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.210565] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.210565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.210565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.210565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.210565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.210565] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 998.213089] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.213245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.213359] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91ceb2dd-d36f-487f-a6af-4cddacfcc5ec with status ACTIVE [ 998.213711] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.213711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.213855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.214400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.214400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.214606] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.214606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.214734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.216160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.216160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.216320] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.216400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.216463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.216621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.216792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.216853] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91ceb2dd-d36f-487f-a6af-4cddacfcc5ec is going to be updated. [ 998.247047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.247047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.247047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.247340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.248716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.248716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91ceb2dd-d36f-487f-a6af-4cddacfcc5ec" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.253869] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.255384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.255384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.255384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.255384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.261035] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.268389] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 998.619111] env[65161]: INFO networking_nsxv3.common.synchronization [req-21ca6be4-a967-4748-bd98-1ee90ca44f2c req-602e9275-f12b-46b2-adca-bc0ceef9fc7d tempest-VolumesAdminNegativeTest-850917886 tempest-VolumesAdminNegativeTest-850917886-project-member] Enqueued Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGHEST for action security_group_members [ 998.620854] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGHEST for action security_group_members [ 998.621301] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc66db19-7999-452e-b762-48cc852535e7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.621463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.621750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.621922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.622098] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.622205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.622265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.622422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.622495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.622597] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.763811] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.127307] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.127486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.127528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.129452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.129452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.129452] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.129452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.129452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.129452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.129654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.129654] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc66db19-7999-452e-b762-48cc852535e7 already deleted. [ 999.129713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.269530] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.270409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.271354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.271354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.271354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.271354] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 999.314386] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.314562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.314630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.314849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.315017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.327069] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 999.532876] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.533142] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-360" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.533421] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-360" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.533624] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-360" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.533928] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.534224] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.534359] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.534941] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.534941] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.534941] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 999.535203] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 999.535203] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 999.535292] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 999.535450] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 999.535559] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 999.535697] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 999.558369] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 999.558548] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 999.558695] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 999.558876] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-360" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.559237] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-6eb9d629-ecfe-4321-a7a1-dcf51612f725 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.559431] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-6eb9d629-ecfe-4321-a7a1-dcf51612f725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.559553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-6eb9d629-ecfe-4321-a7a1-dcf51612f725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.559868] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-6eb9d629-ecfe-4321-a7a1-dcf51612f725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.560013] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb9d629-ecfe-4321-a7a1-dcf51612f725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.971057] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f in Status: SUCCESS [ 999.971351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.063267] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.063528] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.063644] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.064041] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.064348] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.064558] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 6eb9d629-ecfe-4321-a7a1-dcf51612f725 not found, creating... [ 1000.064997] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.065298] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.065487] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.065845] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.066107] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.066559] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.066804] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.066999] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.067361] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.067578] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.067798] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 6eb9d629-ecfe-4321-a7a1-dcf51612f725 is going to be created. [ 1000.090312] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.090531] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.090718] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.091026] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.091280] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.091585] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-6eb9d629-ecfe-4321-a7a1-dcf51612f725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.279445] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1000.279570] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1000.279712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.826243] env[65161]: INFO networking_nsxv3.common.synchronization [req-21ca6be4-a967-4748-bd98-1ee90ca44f2c req-535667c9-615d-4eb2-8126-19768eb12bcd service nova] Enqueued Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGHEST for action security_group_rules [ 1000.826485] env[65161]: INFO networking_nsxv3.common.synchronization [req-21ca6be4-a967-4748-bd98-1ee90ca44f2c req-535667c9-615d-4eb2-8126-19768eb12bcd service nova] Enqueued Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGHEST for action security_group_members [ 1000.826626] env[65161]: INFO networking_nsxv3.common.synchronization [req-21ca6be4-a967-4748-bd98-1ee90ca44f2c req-535667c9-615d-4eb2-8126-19768eb12bcd service nova] Enqueued Resource ID: 6eb9d629-ecfe-4321-a7a1-dcf51612f725 with Priority: HIGHEST for action port [ 1000.827275] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGHEST for action security_group_rules [ 1000.827422] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGHEST for action security_group_members [ 1000.827519] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb9d629-ecfe-4321-a7a1-dcf51612f725 with Priority: HIGHEST for action port [ 1000.827796] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc66db19-7999-452e-b762-48cc852535e7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.827921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.827983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.828397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.828397] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.829916] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc66db19-7999-452e-b762-48cc852535e7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.829916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.829916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.829916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.829916] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.829916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.829916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.830231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.830231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.830231] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.831328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eb9d629-ecfe-4321-a7a1-dcf51612f725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.831460] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eb9d629-ecfe-4321-a7a1-dcf51612f725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.831541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eb9d629-ecfe-4321-a7a1-dcf51612f725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.831658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eb9d629-ecfe-4321-a7a1-dcf51612f725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.831854] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb9d629-ecfe-4321-a7a1-dcf51612f725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.241093] env[65161]: INFO networking_nsxv3.common.synchronization [None req-e22e9776-6b52-42fd-ae7d-dce3029cc60d None None] Enqueued Resource ID: 31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46 with Priority: HIGHEST for action port [ 1001.242047] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46 with Priority: HIGHEST for action port [ 1001.242651] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.243213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.243340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.243707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.244081] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.336682] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc66db19-7999-452e-b762-48cc852535e7 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.337973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.338108] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.339016] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6eb9d629-ecfe-4321-a7a1-dcf51612f725 with status ACTIVE [ 1001.342136] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.342293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.342753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.344413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.344413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.344413] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.344413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.344413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.344645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.344645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.344748] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.344848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.344918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.345198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.345198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.345286] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6eb9d629-ecfe-4321-a7a1-dcf51612f725 is going to be updated. [ 1001.346931] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 1001.347163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.347506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.347668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.347882] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.348217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.348217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.348217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.348217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.348353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.348393] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.377847] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.377847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.377847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.377847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.377847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.377847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eb9d629-ecfe-4321-a7a1-dcf51612f725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.746401] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46 [ 1001.746696] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.746967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.746967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.747186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.751018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.751018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46 already deleted. [ 1001.751018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a8e6c3-765a-42e6-81cd-cbe0d0eaaf46" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.848311] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.851020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.851214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.851214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.851640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.851640] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.851640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.851831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.851831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.851911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.852038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.852161] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.852234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.852288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.852424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.852559] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.852646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.852724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.852889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.854510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.854510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.854510] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.351237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.351649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.351649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.351857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.351974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.352106] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc66db19-7999-452e-b762-48cc852535e7 is going to be created. [ 1002.356816] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 490d862d-f7b2-497d-912a-e1801d9b16ad: rpc.has_security_group_logging(os_id): False [ 1002.379259] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.380245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.380245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.380245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.380245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.380408] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.380601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.380671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.380933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.383067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.383067] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.383067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.383067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.383067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.383067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.383067] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.383067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.383067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.383527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.383527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.383527] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 1002.386550] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.386550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.386550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.386788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.386833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.402340] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc66db19-7999-452e-b762-48cc852535e7 in Status: UNINITIALIZED for 2s [ 1002.482266] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.482266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.482266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.482266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.482266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.502886] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 1003.272656] env[65161]: INFO networking_nsxv3.common.synchronization [req-431491b8-283b-40a1-ad70-907fa0759c20 req-b894c1b8-2f6c-41f6-aac1-b10b9742b9ed tempest-ImagesOneServerNegativeTestJSON-1819154006 tempest-ImagesOneServerNegativeTestJSON-1819154006-project-member] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1003.273472] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1003.273856] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.273955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.274041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.274238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.274406] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.274505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.274583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.274722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.274807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.274898] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.663375] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.663375] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.663375] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.663754] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.664409] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.664409] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.664409] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.664635] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.664635] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.664906] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.665053] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.665188] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.665315] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.665462] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.665593] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.666346] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.686716] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.686889] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.687139] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.687222] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.687529] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-4f7811b3-770a-4c9a-9d32-d095d9a740d8 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.687759] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-4f7811b3-770a-4c9a-9d32-d095d9a740d8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.687885] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-4f7811b3-770a-4c9a-9d32-d095d9a740d8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.688189] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-4f7811b3-770a-4c9a-9d32-d095d9a740d8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.688331] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f7811b3-770a-4c9a-9d32-d095d9a740d8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.741982] env[65161]: INFO networking_nsxv3.common.synchronization [None req-21a03654-2f87-4552-8371-9306804b5a69 None None] Enqueued Resource ID: bca0666e-debe-4061-b073-b151499749f8 with Priority: HIGHEST for action port [ 1003.742632] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bca0666e-debe-4061-b073-b151499749f8 with Priority: HIGHEST for action port [ 1003.743674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-bca0666e-debe-4061-b073-b151499749f8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.743674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bca0666e-debe-4061-b073-b151499749f8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.743674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bca0666e-debe-4061-b073-b151499749f8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.744123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bca0666e-debe-4061-b073-b151499749f8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.744203] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bca0666e-debe-4061-b073-b151499749f8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.777791] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.777979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.778123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.778926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.778926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.778926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.779245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.779245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.780544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.780667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.780898] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 1003.811383] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.811383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.811383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.811383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.811383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.823352] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 1004.191245] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.191467] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.191586] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.191869] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.192025] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.192212] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 4f7811b3-770a-4c9a-9d32-d095d9a740d8 not found, creating... [ 1004.192576] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.192678] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.192722] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.192986] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.193137] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.193420] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.193617] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.193736] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.193954] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.194154] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.194245] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 4f7811b3-770a-4c9a-9d32-d095d9a740d8 is going to be created. [ 1004.214776] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.214993] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.215160] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.215458] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.215664] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.216272] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-4f7811b3-770a-4c9a-9d32-d095d9a740d8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.248777] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bca0666e-debe-4061-b073-b151499749f8 [ 1004.249025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.249156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.249223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.249431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.249519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.249617] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bca0666e-debe-4061-b073-b151499749f8 already deleted. [ 1004.249698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bca0666e-debe-4061-b073-b151499749f8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.411934] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc66db19-7999-452e-b762-48cc852535e7 in Status: SUCCESS [ 1004.412065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.412234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.413215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.413215] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.413215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.413215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.413215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.413215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.413215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.413628] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.518737] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 1004.519623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.789502] env[65161]: INFO networking_nsxv3.common.synchronization [req-bb70151f-95f2-4617-a202-0a36a8d5e874 req-8b99e2fe-d7f6-425b-a8de-b9a6d8dc7730 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1004.790159] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1004.790831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.790831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.790831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.791185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.791185] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.791408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.791408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.791488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.791646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.791646] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.915636] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc66db19-7999-452e-b762-48cc852535e7 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.915936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.916052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.916343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.916598] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.916712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.916812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.917120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.917226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.917325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.917573] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc66db19-7999-452e-b762-48cc852535e7 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.917692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.917743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.917983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.918315] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.918315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.918434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.918545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.918660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.918754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.918851] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.937560] env[65161]: INFO networking_nsxv3.common.synchronization [req-431491b8-283b-40a1-ad70-907fa0759c20 req-a0b53fea-a223-4d95-a4bb-7b85a2ba2bc7 service nova] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_rules [ 1004.937907] env[65161]: INFO networking_nsxv3.common.synchronization [req-431491b8-283b-40a1-ad70-907fa0759c20 req-a0b53fea-a223-4d95-a4bb-7b85a2ba2bc7 service nova] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1004.937907] env[65161]: INFO networking_nsxv3.common.synchronization [req-431491b8-283b-40a1-ad70-907fa0759c20 req-a0b53fea-a223-4d95-a4bb-7b85a2ba2bc7 service nova] Enqueued Resource ID: 4f7811b3-770a-4c9a-9d32-d095d9a740d8 with Priority: HIGHEST for action port [ 1004.938600] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_rules [ 1004.938754] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1004.938857] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7811b3-770a-4c9a-9d32-d095d9a740d8 with Priority: HIGHEST for action port [ 1004.939561] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.939561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.939561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.939759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.939759] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.940699] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.940796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.941622] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f7811b3-770a-4c9a-9d32-d095d9a740d8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.941622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f7811b3-770a-4c9a-9d32-d095d9a740d8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.941622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f7811b3-770a-4c9a-9d32-d095d9a740d8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.941880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f7811b3-770a-4c9a-9d32-d095d9a740d8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.941880] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f7811b3-770a-4c9a-9d32-d095d9a740d8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.296622] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.421499] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc66db19-7999-452e-b762-48cc852535e7: rpc.has_security_group_logging(os_id): False [ 1005.438645] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.438794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.438859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.439098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.439191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.439414] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.439566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.439566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.439827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.439827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.439984] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.440095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.440140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.440278] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.440355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.440528] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.440624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.440699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.440876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.440948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.441083] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc66db19-7999-452e-b762-48cc852535e7 is going to be created. [ 1005.443200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.443336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.446652] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f7811b3-770a-4c9a-9d32-d095d9a740d8 with status ACTIVE [ 1005.446851] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.446958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.447043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.447223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.447307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.447500] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.447600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.447664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.447808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.447925] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.448085] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.448182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.448284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.448389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.448497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.448559] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f7811b3-770a-4c9a-9d32-d095d9a740d8 is going to be updated. [ 1005.467811] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.468037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.468097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.468340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.468534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.468716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f7811b3-770a-4c9a-9d32-d095d9a740d8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.505735] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.509512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.509512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.509512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.509512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.535389] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc66db19-7999-452e-b762-48cc852535e7 in Status: IN_PROGRESS for 2s [ 1005.799606] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.832158] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 1005.832339] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e deletion is rescheduled due to dependency. [ 1005.832450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.832599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.832826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.833046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.834470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.834470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.834470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.834470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.834470] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.304545] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.304715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.304779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.304990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.305156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.305244] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1006.338466] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.346197] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.346725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.347056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.348915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.348915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.358147] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1006.831015] env[65161]: INFO networking_nsxv3.common.synchronization [None req-93978e1f-21de-43a3-8f0c-88f26b873f74 tempest-AttachVolumeTestJSON-1674268260 tempest-AttachVolumeTestJSON-1674268260-project-member] Enqueued Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_rules [ 1006.831711] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_rules [ 1006.832097] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.832229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.832438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.832618] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.832697] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.840139] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.944813] env[65161]: INFO networking_nsxv3.common.synchronization [None req-ee64b01b-1b6b-4010-b9ca-6d7a75518a44 tempest-AttachVolumeTestJSON-1674268260 tempest-AttachVolumeTestJSON-1674268260-project-member] Enqueued Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_rules [ 1006.945334] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_rules [ 1006.945744] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.945744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.343701] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.343701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.343701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.343701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.343701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.343975] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 1007.355486] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.355782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.355861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.356083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.356173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.356269] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 already deleted. [ 1007.356349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.357124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.357124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.357124] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.372294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.372425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.372493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.372696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.372833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.381321] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 1007.547127] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc66db19-7999-452e-b762-48cc852535e7 in Status: SUCCESS [ 1007.547377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.879666] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.879666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.879666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.879666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.879666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.879666] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 already deleted. [ 1007.879666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.373940] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1008.373940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.430057] env[65161]: INFO networking_nsxv3.common.synchronization [req-6c74faf2-3f26-4384-a9c4-a985978cd06c req-95d19946-a5e3-402f-8da1-26d8d9c577bd tempest-ImagesTestJSON-853890535 tempest-ImagesTestJSON-853890535-project-member] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 1008.431036] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGHEST for action security_group_members [ 1008.432968] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.433096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.433096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.436435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.436435] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.436435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.436435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.436435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.436435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.436435] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.937283] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.937975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.937975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.937975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.937975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.938214] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.938362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.938423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.938659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.938754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.938827] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be updated. [ 1008.988545] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.988780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.988780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.988993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.989115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.998201] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: IN_PROGRESS for 2s [ 1009.393085] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 1009.393364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.393765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.394068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.394294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.394418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.394484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.394696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.394744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.394827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.394919] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.897820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.898057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.898057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.898360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.898493] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.898493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.898741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.898741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.898935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.898935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.899111] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.899111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.899337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.899337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.899502] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.899502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.899702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.899702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.899837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.899837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.899948] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.309044] env[65161]: INFO networking_nsxv3.common.synchronization [req-9ac049aa-4264-4aaa-a7de-1c1cf7ff5b13 req-cc2e4905-6f9d-42ad-a03f-e2a1d6131d35 tempest-ServerRescueNegativeTestJSON-1925364810 tempest-ServerRescueNegativeTestJSON-1925364810-project-member] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 1010.309640] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGHEST for action security_group_members [ 1010.309955] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.310116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.310218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.310374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.310561] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.310659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.310738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.310823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.310917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.311010] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.402852] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20c8c1aa-e142-4f0d-9654-9180daa1078e: rpc.has_security_group_logging(os_id): False [ 1010.422698] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.422981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.422981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.423264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.423264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.423451] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.423550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.423614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.423763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.423853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.424083] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.424154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.424224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.424342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.424407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.424597] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.424689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.424750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.424881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.424961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.425043] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 1010.487799] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.487948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.488024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.488239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.488384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.504538] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 1010.735446] env[65161]: INFO networking_nsxv3.common.synchronization [req-1d12dc27-1197-4bc1-a3e9-fe264334346f req-7666cc70-3ffd-45bd-ad17-d4980cbbb406 tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_members [ 1010.735446] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_members [ 1010.736412] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d592aa9d-8cc0-42f6-959d-30654012ec4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.736412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.736412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.737623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.737623] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.737914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.737914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.738050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.738050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.738169] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.816113] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.816918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.817227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.817435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.841518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.841518] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.841846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.841846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.841948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.842013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.842392] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d is going to be updated. [ 1010.870904] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.872544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.872722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.876020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.876020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.886818] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: IN_PROGRESS for 2s [ 1011.015812] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b in Status: SUCCESS [ 1011.016011] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b deletion is rescheduled due to dependency. [ 1011.016140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.132776] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.132985] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.133142] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.133447] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.133736] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.133935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.133935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.134216] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.134382] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.134503] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.135058] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.135058] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.135058] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.135058] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.135058] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.135587] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.155499] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.155789] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.156033] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.156263] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.156679] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-c240896f-b7be-4878-b8b3-fa70ee26beb5 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.156882] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-c240896f-b7be-4878-b8b3-fa70ee26beb5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.157311] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-c240896f-b7be-4878-b8b3-fa70ee26beb5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.157718] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-c240896f-b7be-4878-b8b3-fa70ee26beb5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.157923] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c240896f-b7be-4878-b8b3-fa70ee26beb5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.241407] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.241606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.241685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.241913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.241982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.242195] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.242293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.242353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.242501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.242576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.242657] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d592aa9d-8cc0-42f6-959d-30654012ec4e already deleted. [ 1011.242735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.660793] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.661238] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.661698] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.661804] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.662075] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.662339] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port c240896f-b7be-4878-b8b3-fa70ee26beb5 not found, creating... [ 1011.662769] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.663088] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.663313] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.663695] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.663942] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.664467] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.664723] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.664933] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.665320] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.665551] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.665806] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: c240896f-b7be-4878-b8b3-fa70ee26beb5 is going to be created. [ 1011.692672] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.692923] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.693174] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.693376] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.693624] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.693857] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-c240896f-b7be-4878-b8b3-fa70ee26beb5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.427927] env[65161]: INFO networking_nsxv3.common.synchronization [req-1d12dc27-1197-4bc1-a3e9-fe264334346f req-94ebeb7a-280f-4014-8e37-44eadfa0fcf7 service nova] Enqueued Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_rules [ 1012.428146] env[65161]: INFO networking_nsxv3.common.synchronization [req-1d12dc27-1197-4bc1-a3e9-fe264334346f req-94ebeb7a-280f-4014-8e37-44eadfa0fcf7 service nova] Enqueued Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_members [ 1012.428313] env[65161]: INFO networking_nsxv3.common.synchronization [req-1d12dc27-1197-4bc1-a3e9-fe264334346f req-94ebeb7a-280f-4014-8e37-44eadfa0fcf7 service nova] Enqueued Resource ID: c240896f-b7be-4878-b8b3-fa70ee26beb5 with Priority: HIGHEST for action port [ 1012.428909] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_rules [ 1012.430522] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_members [ 1012.430522] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c240896f-b7be-4878-b8b3-fa70ee26beb5 with Priority: HIGHEST for action port [ 1012.431471] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d592aa9d-8cc0-42f6-959d-30654012ec4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.431613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.431674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.431931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.432019] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.433096] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d592aa9d-8cc0-42f6-959d-30654012ec4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.433256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.433256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.433606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.433708] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.433829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.433895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.434133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.434219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.435390] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.435390] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-c240896f-b7be-4878-b8b3-fa70ee26beb5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.435390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c240896f-b7be-4878-b8b3-fa70ee26beb5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.435390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c240896f-b7be-4878-b8b3-fa70ee26beb5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.435390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c240896f-b7be-4878-b8b3-fa70ee26beb5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.436447] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c240896f-b7be-4878-b8b3-fa70ee26beb5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.520754] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 1012.521185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.897516] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d in Status: SUCCESS [ 1012.898092] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d deletion is rescheduled due to dependency. [ 1012.898092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.938611] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d592aa9d-8cc0-42f6-959d-30654012ec4e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.938817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.939708] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.940026] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c240896f-b7be-4878-b8b3-fa70ee26beb5 with status ACTIVE [ 1012.940263] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.940409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.940498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.940744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.940946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.941244] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.941397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.941489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.941688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.941812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.942044] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.942167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.942240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.942416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.942496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.942583] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c240896f-b7be-4878-b8b3-fa70ee26beb5 is going to be updated. [ 1012.969440] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.969592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.969655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.969858] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.969997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.970172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c240896f-b7be-4878-b8b3-fa70ee26beb5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.445294] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.949523] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.949523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.949523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.949523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.949523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.949523] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d592aa9d-8cc0-42f6-959d-30654012ec4e is going to be created. [ 1013.974340] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.974546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.974546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.974708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.974865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.994289] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d592aa9d-8cc0-42f6-959d-30654012ec4e in Status: UNINITIALIZED for 2s [ 1015.559042] env[65161]: INFO networking_nsxv3.common.synchronization [req-4e2b43af-0c6c-4d90-ba94-26ee71404595 req-11e61afc-9164-4df0-98f3-d1ab5a1ab752 tempest-ServersWithSpecificFlavorTestJSON-1681046468 tempest-ServersWithSpecificFlavorTestJSON-1681046468-project-member] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 1015.559936] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGHEST for action security_group_members [ 1015.560433] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.560433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.560433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.560433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.560655] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.560655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.560801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.560801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.560957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.561300] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.001662] env[65161]: INFO networking_nsxv3.common.synchronization [req-954f9461-8993-4946-8663-a07936e51b79 req-d14fac04-cdc2-4952-abc3-f214a8145950 tempest-VolumesAdminNegativeTest-850917886 tempest-VolumesAdminNegativeTest-850917886-project-member] Enqueued Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGHEST for action security_group_members [ 1016.002177] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGHEST for action security_group_members [ 1016.002492] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc66db19-7999-452e-b762-48cc852535e7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.002632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.002695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.002892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.003623] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.003755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.003866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.004137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.004269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.004376] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.007944] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d592aa9d-8cc0-42f6-959d-30654012ec4e in Status: SUCCESS [ 1016.008150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.008514] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.008900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.009466] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.010629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.010629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.010629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.010629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.010629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.010629] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.064039] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.064039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.064039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.064669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.065408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.065408] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.065408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.065408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.065647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.065647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.065712] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 is going to be updated. [ 1016.097632] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.098166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.098292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.098588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.098942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.110737] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: IN_PROGRESS for 2s [ 1016.509716] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.509809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.509809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.510459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.510459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.510459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.510459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.510943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.510943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.510943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.510943] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc66db19-7999-452e-b762-48cc852535e7 is going to be updated. [ 1016.513791] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.562815] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.564064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.564064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.564301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.564881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.582707] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc66db19-7999-452e-b762-48cc852535e7 in Status: IN_PROGRESS for 2s [ 1017.016652] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d592aa9d-8cc0-42f6-959d-30654012ec4e: rpc.has_security_group_logging(os_id): False [ 1017.039897] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.039897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.039897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.040133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.040133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.041405] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.041405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.041405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.041405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.041405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.041405] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d592aa9d-8cc0-42f6-959d-30654012ec4e is going to be created. [ 1017.115676] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.115890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.115890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.116172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.116401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.130500] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d592aa9d-8cc0-42f6-959d-30654012ec4e in Status: IN_PROGRESS for 2s [ 1017.254857] env[65161]: INFO networking_nsxv3.common.synchronization [req-01fec549-7b53-4b05-b0aa-7277d91ed286 req-99299de0-2ac1-48c3-89fe-1d20f687db73 tempest-ServerRescueTestJSON-311666717 tempest-ServerRescueTestJSON-311666717-project-member] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1017.255548] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1017.255877] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.256009] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.256182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.257449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.257764] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.257942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.258083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.258356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.258505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.258714] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.658126] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.658522] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-697" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.658522] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-697" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.658951] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-697" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.659237] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.659665] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.659835] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.660720] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.660720] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.660720] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.660720] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.660973] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.660973] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.660973] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.661097] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.661231] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.687082] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.687082] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1017.687082] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.687434] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-697" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.687505] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-505dc195-de84-4e79-a0ce-db4b8e5acc64 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.687651] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-505dc195-de84-4e79-a0ce-db4b8e5acc64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.687774] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-505dc195-de84-4e79-a0ce-db4b8e5acc64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.688148] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-505dc195-de84-4e79-a0ce-db4b8e5acc64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.688291] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505dc195-de84-4e79-a0ce-db4b8e5acc64',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.762337] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.762510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.762589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.763023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.763023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.763306] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.763403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.763462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.763574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.763656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.763745] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa already deleted. [ 1017.763847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.123808] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 in Status: SUCCESS [ 1018.123988] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 deletion is rescheduled due to dependency. [ 1018.124206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.190795] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.191204] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.191433] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.191758] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.191969] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.192279] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 505dc195-de84-4e79-a0ce-db4b8e5acc64 not found, creating... [ 1018.192592] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.192935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.193068] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.193329] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.193477] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.193786] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.194067] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.194222] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.194467] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.194637] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.194838] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 505dc195-de84-4e79-a0ce-db4b8e5acc64 is going to be created. [ 1018.216052] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.216345] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.216488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.216838] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.217133] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.217416] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-505dc195-de84-4e79-a0ce-db4b8e5acc64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.597719] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc66db19-7999-452e-b762-48cc852535e7 in Status: SUCCESS [ 1018.597932] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc66db19-7999-452e-b762-48cc852535e7 deletion is rescheduled due to dependency. [ 1018.598059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.947950] env[65161]: INFO networking_nsxv3.common.synchronization [req-01fec549-7b53-4b05-b0aa-7277d91ed286 req-f6bc3608-12a4-4c44-bb02-dcf50eabbac7 service nova] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_rules [ 1018.948286] env[65161]: INFO networking_nsxv3.common.synchronization [req-01fec549-7b53-4b05-b0aa-7277d91ed286 req-f6bc3608-12a4-4c44-bb02-dcf50eabbac7 service nova] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1018.948659] env[65161]: INFO networking_nsxv3.common.synchronization [req-01fec549-7b53-4b05-b0aa-7277d91ed286 req-f6bc3608-12a4-4c44-bb02-dcf50eabbac7 service nova] Enqueued Resource ID: 505dc195-de84-4e79-a0ce-db4b8e5acc64 with Priority: HIGHEST for action port [ 1018.949510] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_rules [ 1018.949718] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1018.949872] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505dc195-de84-4e79-a0ce-db4b8e5acc64 with Priority: HIGHEST for action port [ 1018.950308] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.950536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.950673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.951059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.951194] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.953711] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.953780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.953891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.954198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.954426] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.954584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.954685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.954914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.955062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.955210] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.961058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-505dc195-de84-4e79-a0ce-db4b8e5acc64 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.961058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-505dc195-de84-4e79-a0ce-db4b8e5acc64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.961058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-505dc195-de84-4e79-a0ce-db4b8e5acc64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.961058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-505dc195-de84-4e79-a0ce-db4b8e5acc64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.961058] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505dc195-de84-4e79-a0ce-db4b8e5acc64',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.143773] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d592aa9d-8cc0-42f6-959d-30654012ec4e in Status: SUCCESS [ 1019.144038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.454597] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.454597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.462645] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 505dc195-de84-4e79-a0ce-db4b8e5acc64 with status ACTIVE [ 1019.462645] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.462645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.462645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.462820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.462852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.463109] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.463220] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.463300] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.463555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.463706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.463972] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.464218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.464218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.464309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.465465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.465465] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 505dc195-de84-4e79-a0ce-db4b8e5acc64 is going to be updated. [ 1019.466574] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.490507] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.490507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.490507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.490915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.490915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.490915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-505dc195-de84-4e79-a0ce-db4b8e5acc64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.968374] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.304409] env[65161]: INFO networking_nsxv3.common.synchronization [req-cbac865a-0f42-411b-a6a1-19f729f4c2ee req-d464b1ef-ace0-4b92-aeb0-334726cdc109 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1020.304842] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1020.305327] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.305486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.305599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.305885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.306103] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.306246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.306338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.306561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.306656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.306754] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.472326] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.472326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.472603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.472642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.472784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.472836] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be created. [ 1020.503136] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.503376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.503452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.503686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.503808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.513875] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: UNINITIALIZED for 2s [ 1020.675038] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.675681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.676119] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.676486] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.676838] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.677029] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.677160] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.677575] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.677646] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.677861] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.677976] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.678112] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.678262] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.678381] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.678491] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.678660] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.700798] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.701053] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.701205] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.701388] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.701697] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-76e5787a-9f68-4a62-9b74-169dee9f2b59 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.701866] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-76e5787a-9f68-4a62-9b74-169dee9f2b59" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.701986] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-76e5787a-9f68-4a62-9b74-169dee9f2b59" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.702459] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-76e5787a-9f68-4a62-9b74-169dee9f2b59" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.702660] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76e5787a-9f68-4a62-9b74-169dee9f2b59',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.809601] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.809783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.809892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.810201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.810344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.810604] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.810727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.810792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.811035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.811134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.811226] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be deleted. [ 1020.846477] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.846732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.846790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.847033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.847161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.847325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.205121] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.205121] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.205121] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.205608] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.205665] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.205842] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 76e5787a-9f68-4a62-9b74-169dee9f2b59 not found, creating... [ 1021.206326] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.206326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.206493] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.206617] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.206778] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.207048] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.207572] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.207572] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.207572] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.207752] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.207814] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 76e5787a-9f68-4a62-9b74-169dee9f2b59 is going to be created. [ 1021.228522] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.228871] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.228871] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.229224] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.229489] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.229742] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-76e5787a-9f68-4a62-9b74-169dee9f2b59" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.929635] env[65161]: INFO networking_nsxv3.common.synchronization [req-cbac865a-0f42-411b-a6a1-19f729f4c2ee req-ae8566be-1542-4a65-b78a-a9c4db50374a service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 1021.929801] env[65161]: INFO networking_nsxv3.common.synchronization [req-cbac865a-0f42-411b-a6a1-19f729f4c2ee req-ae8566be-1542-4a65-b78a-a9c4db50374a service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1021.929944] env[65161]: INFO networking_nsxv3.common.synchronization [req-cbac865a-0f42-411b-a6a1-19f729f4c2ee req-ae8566be-1542-4a65-b78a-a9c4db50374a service nova] Enqueued Resource ID: 76e5787a-9f68-4a62-9b74-169dee9f2b59 with Priority: HIGHEST for action port [ 1021.930186] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 1021.930353] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1021.932309] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76e5787a-9f68-4a62-9b74-169dee9f2b59 with Priority: HIGHEST for action port [ 1021.932309] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.932309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.932309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.932309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.932309] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.934332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.934332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.934332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.934332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.934332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.934332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.934332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.934332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.934332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.934332] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.935298] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-76e5787a-9f68-4a62-9b74-169dee9f2b59 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.935729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76e5787a-9f68-4a62-9b74-169dee9f2b59" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.935729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76e5787a-9f68-4a62-9b74-169dee9f2b59" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.935816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76e5787a-9f68-4a62-9b74-169dee9f2b59" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.937809] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76e5787a-9f68-4a62-9b74-169dee9f2b59',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.438851] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.439890] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.440042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.440185] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76e5787a-9f68-4a62-9b74-169dee9f2b59 with status ACTIVE [ 1022.440335] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.440523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.440523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.440698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.440784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.440948] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.441100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.441180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.441291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.441370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.441551] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.441660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.441700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.441851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.441924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.442084] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76e5787a-9f68-4a62-9b74-169dee9f2b59 is going to be updated. [ 1022.468487] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.468487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.468487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.468487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.468487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.468487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76e5787a-9f68-4a62-9b74-169dee9f2b59" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.524828] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: SUCCESS [ 1022.525065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.525236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.525565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.525812] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.525950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.526037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.526202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.526288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.526376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.526467] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.944511] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.028890] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.029106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.029151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.029365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.029560] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.029743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.029743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.029845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.029927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.030028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.030181] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.030272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.030332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.030467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.030606] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.030696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.030753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.030888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.030963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.031071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.031211] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.171854] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1023.172067] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:2 started [ 1023.447051] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.447459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.447459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.447459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.447601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.447601] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be created. [ 1023.474350] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.474752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.474920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.475278] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.475574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.489920] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: UNINITIALIZED for 2s [ 1023.533685] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa: rpc.has_security_group_logging(os_id): False [ 1023.555752] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.555974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.555974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.556232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.556328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.556640] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.556759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.556838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.557115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.557276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.557531] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.557634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.557714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.557878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.557966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.558201] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.558298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.558362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.558535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.558605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.558690] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be created. [ 1023.622576] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.622772] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.622833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.623111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.623305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.635807] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: IN_PROGRESS for 2s [ 1025.502023] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1025.502337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.502505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.502734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.502918] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.503063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.503195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.503356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.503498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.503564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.503606] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.656150] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: SUCCESS [ 1025.656377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.006197] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.007101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.007234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.007462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.007732] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.007868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.008715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.008715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.008715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.008715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.008715] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.008715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.008715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.008715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.009147] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.009147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.009147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.009147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.009284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.009456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.009522] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.517382] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 200ba9e0-f56c-4b5d-9e39-69a507140fda: rpc.has_security_group_logging(os_id): False [ 1026.543566] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.543714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.543785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.544014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.544108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.544306] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.544404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.544467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.544622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.544721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.544923] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.545034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.545097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.545235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.545303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.545485] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.545597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.545693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.545886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.545964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.546101] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be created. [ 1026.628278] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.628753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.628880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.629372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.629810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.649468] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1026.931190] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1026.931342] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1026.966752] env[65161]: INFO networking_nsxv3.common.synchronization [req-23bb444b-2415-4bfc-95a2-752c88fce884 req-87f4e819-89c1-40f0-b396-a0f1a1670551 tempest-ImagesOneServerNegativeTestJSON-1819154006 tempest-ImagesOneServerNegativeTestJSON-1819154006-project-member] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1026.967325] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1026.967711] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.967846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.967902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.968093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.968240] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.968340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.968733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.968733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.968733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.968733] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.367684] env[65161]: INFO networking_nsxv3.common.synchronization [req-dfb5d4e1-2d4a-43c3-a124-eade71c6bba1 req-bb16879f-9ae0-4fb4-b422-8419ca461343 tempest-AttachVolumeTestJSON-1674268260 tempest-AttachVolumeTestJSON-1674268260-project-member] Enqueued Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_members [ 1027.367684] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_members [ 1027.367898] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.367898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.368056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.368223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.368366] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.368487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.368554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.368671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.368768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.368847] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.472027] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.472253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.472253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.472424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.472535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.472742] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.472846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.472901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.473080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.473210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.473271] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 1027.501226] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.501357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.501416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.501659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.501806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.511578] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 1027.627580] env[65161]: INFO networking_nsxv3.common.synchronization [None req-5598f382-bb08-4b8d-94c7-b97e6274a887 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1027.629098] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1027.629657] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.629828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.629925] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.630215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.630561] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.630710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.630808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.631021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.631169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.631315] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.779064] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-254 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.779064] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-254" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.779064] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-254" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.779064] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-254" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.780647] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.781214] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.781738] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.783023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.783023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.783023] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.783023] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.783023] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.783023] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.783023] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.783462] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.783737] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.805389] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.808124] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.808124] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.808124] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-254" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.808124] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.808124] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.808124] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.808124] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.808816] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.871267] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.871360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.871433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.871729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.871827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.872046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.872164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.872254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.872461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.872821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.872821] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 already deleted. [ 1027.872821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.135317] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.311983] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.312274] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.312491] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.312673] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.312824] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.312972] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9 not found, creating... [ 1028.313351] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.313485] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.313593] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.313845] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.313983] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.314470] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.314914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.314914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.315039] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.315120] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.315232] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9 is going to be created. [ 1028.338330] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.338561] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.338668] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.338962] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.339215] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.339452] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.637532] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.662748] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1028.662748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.057019] env[65161]: INFO networking_nsxv3.common.synchronization [req-dfb5d4e1-2d4a-43c3-a124-eade71c6bba1 req-9f1300c4-0145-4a9c-b2b3-7a58ce5c4ddc service nova] Enqueued Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_rules [ 1029.057019] env[65161]: INFO networking_nsxv3.common.synchronization [req-dfb5d4e1-2d4a-43c3-a124-eade71c6bba1 req-9f1300c4-0145-4a9c-b2b3-7a58ce5c4ddc service nova] Enqueued Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_members [ 1029.057019] env[65161]: INFO networking_nsxv3.common.synchronization [req-dfb5d4e1-2d4a-43c3-a124-eade71c6bba1 req-9f1300c4-0145-4a9c-b2b3-7a58ce5c4ddc service nova] Enqueued Resource ID: 63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9 with Priority: HIGHEST for action port [ 1029.057019] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_rules [ 1029.057019] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_members [ 1029.057456] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9 with Priority: HIGHEST for action port [ 1029.058135] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.058353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.058512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.061020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.061020] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.061020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.061020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.061020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.061020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.061020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.061020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.061020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.061020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.061020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.061020] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.062859] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.063185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.063451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.063753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.063948] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.142081] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.142081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.142081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.142081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.142081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.142371] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be updated. [ 1029.175669] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.175849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.175923] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.176147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.176308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.189253] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1029.525487] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 1029.525487] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e deletion is rescheduled due to dependency. [ 1029.525487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.566358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.566507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.566709] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.567718] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9 with status ACTIVE [ 1029.567906] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.568045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.568099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.568311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.568403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.568577] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.568674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.568736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.568929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.568976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.569143] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.569238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.569298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.569560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.569777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.569777] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9 is going to be updated. [ 1029.594784] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.594784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.594784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.594784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.594981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.594981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63835a64-1a1e-4d3e-b2e2-82c7e2d8dec9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.989270] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.989563] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.989563] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.989704] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.989959] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.990124] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.990239] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.990451] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.990587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.990792] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.990904] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.991020] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.991235] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.991378] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.991488] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.991621] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.035438] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.035622] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.035773] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.035949] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.036302] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-de032783-bf17-40c3-ad62-79d81aa4c76f taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.036483] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-de032783-bf17-40c3-ad62-79d81aa4c76f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.036603] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-de032783-bf17-40c3-ad62-79d81aa4c76f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.036944] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-de032783-bf17-40c3-ad62-79d81aa4c76f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.037095] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de032783-bf17-40c3-ad62-79d81aa4c76f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.072593] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.543436] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.543436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.543436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.543436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.543436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.543436] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port de032783-bf17-40c3-ad62-79d81aa4c76f not found, creating... [ 1030.543436] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.543436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.543436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.544259] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.544259] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.544340] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.544532] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.544653] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.544906] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.545096] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.545277] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: de032783-bf17-40c3-ad62-79d81aa4c76f is going to be created. [ 1030.569263] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.569569] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.569722] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.570099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.570511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.570734] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-de032783-bf17-40c3-ad62-79d81aa4c76f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.575283] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.575740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.575740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.575954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.575954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.576096] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 is going to be created. [ 1030.605277] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.605277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.605277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.605683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.605843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.624930] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64d87f90-5895-4771-acb4-8aaeff02c417 in Status: UNINITIALIZED for 2s [ 1031.206158] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1031.206504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.269429] env[65161]: INFO networking_nsxv3.common.synchronization [req-0a58639b-a32c-4a82-b2c4-41581fb90be8 req-1f46026f-4831-45ea-8a27-d15c14d7af72 service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 1031.271069] env[65161]: INFO networking_nsxv3.common.synchronization [req-0a58639b-a32c-4a82-b2c4-41581fb90be8 req-1f46026f-4831-45ea-8a27-d15c14d7af72 service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1031.271069] env[65161]: INFO networking_nsxv3.common.synchronization [req-0a58639b-a32c-4a82-b2c4-41581fb90be8 req-1f46026f-4831-45ea-8a27-d15c14d7af72 service nova] Enqueued Resource ID: de032783-bf17-40c3-ad62-79d81aa4c76f with Priority: HIGHEST for action port [ 1031.271069] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 1031.271069] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1031.271354] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de032783-bf17-40c3-ad62-79d81aa4c76f with Priority: HIGHEST for action port [ 1031.272560] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.272560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.272560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.272560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.272560] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.273837] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.274183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.275112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.275112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.275609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.275609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.275609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.276055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.276206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.276374] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.277909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-de032783-bf17-40c3-ad62-79d81aa4c76f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.278052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de032783-bf17-40c3-ad62-79d81aa4c76f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.278120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de032783-bf17-40c3-ad62-79d81aa4c76f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.278434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de032783-bf17-40c3-ad62-79d81aa4c76f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.278547] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de032783-bf17-40c3-ad62-79d81aa4c76f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.775081] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.775313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.778707] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.780897] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de032783-bf17-40c3-ad62-79d81aa4c76f with status ACTIVE [ 1031.781307] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.781307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.781468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.781573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.781667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.781871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.781989] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.782075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.782275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.782374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.782733] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.782733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.782733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.782917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.782987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.783101] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de032783-bf17-40c3-ad62-79d81aa4c76f is going to be updated. [ 1031.805464] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.805658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.805704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.805915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.807213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.807213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de032783-bf17-40c3-ad62-79d81aa4c76f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.286234] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.635179] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64d87f90-5895-4771-acb4-8aaeff02c417 in Status: SUCCESS [ 1032.635379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.635770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.635987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.636195] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.636312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.636370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.636518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.636604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.636681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.636770] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.790196] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.790196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.791421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.791421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.791421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.791421] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be updated. [ 1032.821330] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.821330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.821330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.821330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.821330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.829714] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1033.138866] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.641064] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64d87f90-5895-4771-acb4-8aaeff02c417: rpc.has_security_group_logging(os_id): False [ 1033.660322] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.660446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.660521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.660747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.660840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.661089] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.661189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.661438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.661438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.661565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.661565] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 is going to be created. [ 1033.726697] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.726993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.726993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.727164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.727355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.740119] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64d87f90-5895-4771-acb4-8aaeff02c417 in Status: IN_PROGRESS for 2s [ 1033.742572] env[65161]: INFO networking_nsxv3.common.synchronization [req-76bb1246-14bd-42f5-866c-577736db5dc4 req-118742a8-e1e9-4f91-99bd-77d3feb05385 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1033.743080] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1033.743440] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.743557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.744268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.744268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.744268] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.744268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.744268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.744268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.744545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.744545] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.104492] env[65161]: INFO networking_nsxv3.common.synchronization [req-828fc3f1-5e92-4c1a-9f0d-b6dfd45518e5 req-a33f41ac-7b89-40df-aef4-5e9de2b75a54 tempest-MigrationsAdminTest-2053071831 tempest-MigrationsAdminTest-2053071831-project-member] Enqueued Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 1034.104632] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 1034.104962] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.105276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.105366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.105578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.105861] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.105861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.105955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.106074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.106165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.106273] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.215167] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.215392] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.215596] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.215898] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.216179] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.216638] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.216638] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.216746] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.216871] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.217062] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.217184] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.217285] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.217387] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.217493] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.217595] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.217722] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.236342] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.236547] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.236636] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.236867] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.237199] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-04a23109-06c9-4e3c-b163-115ce984abcf taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.237376] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-04a23109-06c9-4e3c-b163-115ce984abcf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.237520] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-04a23109-06c9-4e3c-b163-115ce984abcf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.237857] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-04a23109-06c9-4e3c-b163-115ce984abcf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.237997] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04a23109-06c9-4e3c-b163-115ce984abcf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.247126] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.247323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.247323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.247536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.247627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.247866] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.247943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.248041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.248168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.248244] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.248332] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1034.274644] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.274644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.274644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.274644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.274644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.284566] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1034.609158] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.740574] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.740899] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.740949] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.741245] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.741400] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.741567] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 04a23109-06c9-4e3c-b163-115ce984abcf not found, creating... [ 1034.741823] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.741981] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.742282] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.742364] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.742535] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.745786] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.745786] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.745786] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.745786] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.745786] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.745786] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 04a23109-06c9-4e3c-b163-115ce984abcf is going to be created. [ 1034.767420] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.767739] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.767821] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.768420] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.768665] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.768920] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-04a23109-06c9-4e3c-b163-115ce984abcf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.841249] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1034.841473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.841659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.841922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.842142] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.842250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.842319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.842532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.842631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.842718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.842813] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.112077] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.347992] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.348327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.348327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.348639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.348639] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.348821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.348821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.348936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.349035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.349125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.349271] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.349363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.349431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.349569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.349718] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.349869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.349869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.350015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.350093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.350174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.350262] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.525935] env[65161]: INFO networking_nsxv3.common.synchronization [req-76bb1246-14bd-42f5-866c-577736db5dc4 req-6ab174ef-9776-4cad-85ea-7cd0f144fdd6 service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1035.526169] env[65161]: INFO networking_nsxv3.common.synchronization [req-76bb1246-14bd-42f5-866c-577736db5dc4 req-6ab174ef-9776-4cad-85ea-7cd0f144fdd6 service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1035.526330] env[65161]: INFO networking_nsxv3.common.synchronization [req-76bb1246-14bd-42f5-866c-577736db5dc4 req-6ab174ef-9776-4cad-85ea-7cd0f144fdd6 service nova] Enqueued Resource ID: 04a23109-06c9-4e3c-b163-115ce984abcf with Priority: HIGHEST for action port [ 1035.526919] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1035.527789] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1035.528265] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a23109-06c9-4e3c-b163-115ce984abcf with Priority: HIGHEST for action port [ 1035.528436] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.528605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.528719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.528950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.529184] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.530160] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.530356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.530716] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-04a23109-06c9-4e3c-b163-115ce984abcf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.530921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04a23109-06c9-4e3c-b163-115ce984abcf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.531302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04a23109-06c9-4e3c-b163-115ce984abcf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.531876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04a23109-06c9-4e3c-b163-115ce984abcf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.532246] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04a23109-06c9-4e3c-b163-115ce984abcf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.615360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.615951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.615951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.615951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.616150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.616150] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee is going to be updated. [ 1035.673695] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.673912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.674019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.675020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.675020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.684923] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: IN_PROGRESS for 2s [ 1035.755465] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64d87f90-5895-4771-acb4-8aaeff02c417 in Status: SUCCESS [ 1035.755837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.853054] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 200ba9e0-f56c-4b5d-9e39-69a507140fda: rpc.has_security_group_logging(os_id): False [ 1035.872698] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.872992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.873107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.873439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.873625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.873843] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.873950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.874015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.874175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.874252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.874470] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.874567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.874630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.874760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.874843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.875046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.875127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.875162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.875290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.875358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.875437] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be updated. [ 1035.973671] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.974016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.974016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.974125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.974238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.987111] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1036.038719] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.038719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.038719] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04a23109-06c9-4e3c-b163-115ce984abcf with status ACTIVE [ 1036.038719] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.038719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.038719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.038719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.038719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.038719] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.039671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.039671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.039671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.039671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.039671] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.040037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.040037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.040264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.040264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.040264] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04a23109-06c9-4e3c-b163-115ce984abcf is going to be updated. [ 1036.068800] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.069043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.069157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.069470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.069673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.069912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04a23109-06c9-4e3c-b163-115ce984abcf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.295873] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1036.296187] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1036.296377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.296631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.296973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.298231] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.298231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.298231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.298231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.298231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.298231] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.801038] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.275850] env[65161]: INFO networking_nsxv3.common.synchronization [None req-1cc52c34-ef2a-4c7a-ba7f-a8fd28e2591c None None] Enqueued Resource ID: 7ae4a24d-dafa-48ea-a2e1-9afe27be6093 with Priority: HIGHEST for action port [ 1037.276441] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae4a24d-dafa-48ea-a2e1-9afe27be6093 with Priority: HIGHEST for action port [ 1037.276831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ae4a24d-dafa-48ea-a2e1-9afe27be6093 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.276831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ae4a24d-dafa-48ea-a2e1-9afe27be6093" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.277071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ae4a24d-dafa-48ea-a2e1-9afe27be6093" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.277138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ae4a24d-dafa-48ea-a2e1-9afe27be6093" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.277194] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ae4a24d-dafa-48ea-a2e1-9afe27be6093',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.303367] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.698812] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: SUCCESS [ 1037.698957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.779523] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ae4a24d-dafa-48ea-a2e1-9afe27be6093 [ 1037.780205] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.780362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.780435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.780644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.780734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.780829] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ae4a24d-dafa-48ea-a2e1-9afe27be6093 already deleted. [ 1037.780909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ae4a24d-dafa-48ea-a2e1-9afe27be6093" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.807175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.807175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.807175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.807755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.809193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.809193] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1037.844166] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.844166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.844166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.844166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.844430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.856686] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1038.003023] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1038.003023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.628092] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c5ae4e08-ba14-4be5-8e72-b315553ac180 None None] Enqueued Resource ID: e5a3a522-2453-4e7d-8dbe-d1a76e5fc841 with Priority: HIGHEST for action port [ 1039.628965] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5a3a522-2453-4e7d-8dbe-d1a76e5fc841 with Priority: HIGHEST for action port [ 1039.628965] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5a3a522-2453-4e7d-8dbe-d1a76e5fc841 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.632537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5a3a522-2453-4e7d-8dbe-d1a76e5fc841" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.632686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5a3a522-2453-4e7d-8dbe-d1a76e5fc841" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.632975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5a3a522-2453-4e7d-8dbe-d1a76e5fc841" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.633098] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5a3a522-2453-4e7d-8dbe-d1a76e5fc841',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.866068] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1039.866196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.866286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.866500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.866895] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.866895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.866895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.867107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.867107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.867188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.867303] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.051061] env[65161]: INFO networking_nsxv3.common.synchronization [req-85c89b2b-c3da-40e8-8444-48830ee935c5 req-ef2ab79b-514a-4112-9131-31d822b36676 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1040.052370] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1040.052370] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.052370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.052370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.052606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.052606] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.052685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.052739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.052910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.052994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.053092] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.137743] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5a3a522-2453-4e7d-8dbe-d1a76e5fc841 [ 1040.137743] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.137743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.137743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.138084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.138084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.138174] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5a3a522-2453-4e7d-8dbe-d1a76e5fc841 already deleted. [ 1040.138278] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5a3a522-2453-4e7d-8dbe-d1a76e5fc841" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.370565] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.370782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.370837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.371338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.371692] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.371835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.371901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.372051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.372146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.372314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.372396] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.372528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.372528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.372528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.372915] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.372915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.373026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.373129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.373200] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.373295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.373387] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.545690] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.545934] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.546096] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.546366] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.546624] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.546782] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.546898] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.550832] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.551154] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.551425] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.551637] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.551984] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.552209] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.552334] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.555097] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.555311] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.560302] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.578281] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.578281] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.578281] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.578281] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.578281] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-06a1c607-7f02-47cd-8ebd-7455751df3b1 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.578281] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-06a1c607-7f02-47cd-8ebd-7455751df3b1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.578791] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-06a1c607-7f02-47cd-8ebd-7455751df3b1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.578791] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-06a1c607-7f02-47cd-8ebd-7455751df3b1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.578915] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06a1c607-7f02-47cd-8ebd-7455751df3b1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.876589] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ad3588-f61e-418d-9a8e-c65add44c1be: rpc.has_security_group_logging(os_id): False [ 1040.895121] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.895306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.895356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.895663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.895782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.895944] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.896070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.896120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.896386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.896500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.896707] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.896863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.896863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.897012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.897226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.897436] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.897570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.897621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.897786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.897860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.897984] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1040.962953] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.963168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.963219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.963621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.964094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.978399] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1041.062468] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.080962] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.081306] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.081455] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.081837] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.082024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.082206] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 06a1c607-7f02-47cd-8ebd-7455751df3b1 not found, creating... [ 1041.082785] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.082785] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.082785] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.083078] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.083463] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.083575] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.083774] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.083908] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.084293] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.084528] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.084876] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 06a1c607-7f02-47cd-8ebd-7455751df3b1 is going to be created. [ 1041.114853] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.115832] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.115832] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.115832] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.116232] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.116554] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-06a1c607-7f02-47cd-8ebd-7455751df3b1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.565528] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.565701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.565774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.565992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.567062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.567062] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1041.599943] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.600102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.600174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.600382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.600524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.609556] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1041.807906] env[65161]: INFO networking_nsxv3.common.synchronization [req-85c89b2b-c3da-40e8-8444-48830ee935c5 req-de66729d-8aa1-43b5-92fe-4f2f3e6e232f service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1041.808126] env[65161]: INFO networking_nsxv3.common.synchronization [req-85c89b2b-c3da-40e8-8444-48830ee935c5 req-de66729d-8aa1-43b5-92fe-4f2f3e6e232f service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1041.808277] env[65161]: INFO networking_nsxv3.common.synchronization [req-85c89b2b-c3da-40e8-8444-48830ee935c5 req-de66729d-8aa1-43b5-92fe-4f2f3e6e232f service nova] Enqueued Resource ID: 06a1c607-7f02-47cd-8ebd-7455751df3b1 with Priority: HIGHEST for action port [ 1041.808784] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1041.808919] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1041.809046] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1c607-7f02-47cd-8ebd-7455751df3b1 with Priority: HIGHEST for action port [ 1041.809328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.809907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.809985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.810224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.810315] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.813205] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.813205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.813205] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-06a1c607-7f02-47cd-8ebd-7455751df3b1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.813205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06a1c607-7f02-47cd-8ebd-7455751df3b1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.813205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06a1c607-7f02-47cd-8ebd-7455751df3b1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.813205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06a1c607-7f02-47cd-8ebd-7455751df3b1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.813205] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06a1c607-7f02-47cd-8ebd-7455751df3b1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.314079] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.314367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.316934] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06a1c607-7f02-47cd-8ebd-7455751df3b1 with status ACTIVE [ 1042.316934] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.316934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.317105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.318094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.318094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.318094] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.318094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.318094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.318094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.318094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.318094] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.318094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.318759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.318759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.318759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.318759] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06a1c607-7f02-47cd-8ebd-7455751df3b1 is going to be updated. [ 1042.341108] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.341339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.341339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.341637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.341722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.341808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06a1c607-7f02-47cd-8ebd-7455751df3b1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.993627] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1042.993627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.620618] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1043.620954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.620954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.621197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.621501] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.621645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.621708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.621864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.621947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.622061] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.128150] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.635323] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.138888] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.138888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.138888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.138888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.138888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.138888] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1045.180813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.181636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.181755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.182071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.182287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.194367] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1045.905273] env[65161]: INFO networking_nsxv3.common.synchronization [req-3bae0cf8-cc7d-4576-a5d8-1ac81d9a6143 req-56229c3f-ad89-458f-8802-e99c9d5ab06a tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_members [ 1045.905273] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGHEST for action security_group_members [ 1045.905273] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.905273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.905273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.905713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.905713] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.905713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.905857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.905857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.905931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.906305] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.408514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.409458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.409458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.411788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.411788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.411788] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.411788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.411788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.411788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.411788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.411788] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f is going to be updated. [ 1046.442025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.442025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.442025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.442025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.442025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.451685] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f in Status: IN_PROGRESS for 2s [ 1047.206477] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1047.206710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.206942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.207231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.207482] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.207623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.207707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.207911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.208027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.208132] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.208228] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.712893] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.713082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.713237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.713319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.713534] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.713788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.713788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.713895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.713952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.714288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.714288] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.714288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.714447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.714484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.714635] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.714755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.714801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.714922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.715077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.715077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.715373] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.832920] env[65161]: INFO networking_nsxv3.common.synchronization [req-edccdd60-3d08-45b6-ae1f-8527a919f5d5 req-58886759-cb59-4008-8426-df1a8f9a2994 tempest-ServerTagsTestJSON-1123938404 tempest-ServerTagsTestJSON-1123938404-project-member] Enqueued Resource ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe with Priority: HIGHEST for action security_group_members [ 1047.833566] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe with Priority: HIGHEST for action security_group_members [ 1047.833891] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6815e7f8-d060-497e-9594-0ed8cadfdffe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.834174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.834476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.834582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.834723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.834846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.834914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.835103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.835203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.835294] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6815e7f8-d060-497e-9594-0ed8cadfdffe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.124801] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.124801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.124801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.125112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.125240] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.218239] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caaaa94-1988-4a64-baf8-2e9ad4c3a553: rpc.has_security_group_logging(os_id): False [ 1048.238075] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.238253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.238342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.238671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.238810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.239059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.239187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.239261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.239426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.239530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.239832] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.239930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.239970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.240155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.240242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.240549] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.240699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.240819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.241079] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.241189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.241333] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1048.278970] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-906 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.279282] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-906" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.279461] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-906" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.279826] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-906" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.280543] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.280543] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.280731] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.280895] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.281134] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.281449] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.281615] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.281768] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.281919] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.282086] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.282252] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.282466] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.307144] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.307415] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.307577] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.307786] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-906" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.308142] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-7f88b93b-8ed4-4204-9529-c8fb68ae1944 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.308359] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-7f88b93b-8ed4-4204-9529-c8fb68ae1944" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.308573] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-7f88b93b-8ed4-4204-9529-c8fb68ae1944" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.309045] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-7f88b93b-8ed4-4204-9529-c8fb68ae1944" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.309230] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f88b93b-8ed4-4204-9529-c8fb68ae1944',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.320412] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.320767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.320767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.320859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.320956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.337035] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1048.337331] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.337511] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.337609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.337823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.337944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.338158] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.338284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.338349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.338502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.338600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.338698] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe already deleted. [ 1048.338773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.389337] env[65161]: INFO networking_nsxv3.common.synchronization [req-678cf8e4-98d0-4791-b667-767974458d2a req-245c4161-b81c-46d3-b8aa-10534804b8fb tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1048.390086] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1048.390634] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.390782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.390869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.391130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.391296] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.391427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.391510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.391705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.391788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.391884] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.463618] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f in Status: SUCCESS [ 1048.463618] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f deletion is rescheduled due to dependency. [ 1048.463618] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.627907] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.812713] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.812713] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.812845] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.813292] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.813292] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.814150] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 7f88b93b-8ed4-4204-9529-c8fb68ae1944 not found, creating... [ 1048.814150] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.814150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.814150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.814150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.814354] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.814520] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.814708] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.814824] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.815042] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.815177] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.815312] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 7f88b93b-8ed4-4204-9529-c8fb68ae1944 is going to be created. [ 1048.834732] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.834933] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.835076] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.835364] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.835593] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.835820] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-7f88b93b-8ed4-4204-9529-c8fb68ae1944" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.894555] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.131624] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.389630] env[65161]: INFO networking_nsxv3.common.synchronization [None req-89fcca95-79c3-4c46-b93c-3bed3b661cda tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1049.391212] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1049.391212] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.391212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.397631] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.568216] env[65161]: INFO networking_nsxv3.common.synchronization [req-edccdd60-3d08-45b6-ae1f-8527a919f5d5 req-fafa0c6b-dc13-440b-9ece-958a55dc0ac2 service nova] Enqueued Resource ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe with Priority: HIGHEST for action security_group_rules [ 1049.568216] env[65161]: INFO networking_nsxv3.common.synchronization [req-edccdd60-3d08-45b6-ae1f-8527a919f5d5 req-fafa0c6b-dc13-440b-9ece-958a55dc0ac2 service nova] Enqueued Resource ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe with Priority: HIGHEST for action security_group_members [ 1049.568216] env[65161]: INFO networking_nsxv3.common.synchronization [req-edccdd60-3d08-45b6-ae1f-8527a919f5d5 req-fafa0c6b-dc13-440b-9ece-958a55dc0ac2 service nova] Enqueued Resource ID: 7f88b93b-8ed4-4204-9529-c8fb68ae1944 with Priority: HIGHEST for action port [ 1049.568216] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe with Priority: HIGHEST for action security_group_rules [ 1049.568216] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe with Priority: HIGHEST for action security_group_members [ 1049.568960] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f88b93b-8ed4-4204-9529-c8fb68ae1944 with Priority: HIGHEST for action port [ 1049.573199] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6815e7f8-d060-497e-9594-0ed8cadfdffe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.573199] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6815e7f8-d060-497e-9594-0ed8cadfdffe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.573199] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6815e7f8-d060-497e-9594-0ed8cadfdffe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.573199] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.573199] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6815e7f8-d060-497e-9594-0ed8cadfdffe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.573199] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f88b93b-8ed4-4204-9529-c8fb68ae1944 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f88b93b-8ed4-4204-9529-c8fb68ae1944" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.573199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f88b93b-8ed4-4204-9529-c8fb68ae1944" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.574314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f88b93b-8ed4-4204-9529-c8fb68ae1944" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.575834] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f88b93b-8ed4-4204-9529-c8fb68ae1944',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.635032] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1049.635032] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1049.798436] env[65161]: INFO networking_nsxv3.common.synchronization [req-dd4261fb-2c0d-42bc-b278-f8c12cfc7b55 req-253d8b47-f200-4b38-b30c-5415a7017428 tempest-MigrationsAdminTest-2053071831 tempest-MigrationsAdminTest-2053071831-project-member] Enqueued Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 1049.799311] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee with Priority: HIGHEST for action security_group_members [ 1049.799311] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.799466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.799466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.799645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.799795] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.799892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.799948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.800224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.800319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.800416] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9f4e7d3-15ff-431e-9c10-7ea15b2417ee',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.901519] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.901713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.901783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.901993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.902099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.902196] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be updated. [ 1049.923183] env[65161]: INFO networking_nsxv3.common.synchronization [None req-2db68655-4eac-4ff4-87ac-ef381c6d3931 None None] Enqueued Resource ID: 82beedde-2995-4913-bbdf-905687660aa8 with Priority: HIGHEST for action port [ 1049.931581] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82beedde-2995-4913-bbdf-905687660aa8 with Priority: HIGHEST for action port [ 1049.932425] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-82beedde-2995-4913-bbdf-905687660aa8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.932765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82beedde-2995-4913-bbdf-905687660aa8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.932765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82beedde-2995-4913-bbdf-905687660aa8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.932900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82beedde-2995-4913-bbdf-905687660aa8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.932936] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82beedde-2995-4913-bbdf-905687660aa8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.936105] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.936223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.936879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.936879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.936879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.946480] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1050.077839] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6815e7f8-d060-497e-9594-0ed8cadfdffe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.077839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.078845] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6815e7f8-d060-497e-9594-0ed8cadfdffe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.079824] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f88b93b-8ed4-4204-9529-c8fb68ae1944 with status ACTIVE [ 1050.084106] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.084106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.084106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.084106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.084292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.084515] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.084631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.084697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.085383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.085383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.085383] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.085564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.085564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.086519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.086519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.086519] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f88b93b-8ed4-4204-9529-c8fb68ae1944 is going to be updated. [ 1050.109654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.109654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.110029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.110029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.110482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.110752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f88b93b-8ed4-4204-9529-c8fb68ae1944" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.303761] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.303761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.303882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.304047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.304139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.304338] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.304945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.304945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.304945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.304945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.304945] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee is going to be updated. [ 1050.358868] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.358868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.358868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.358868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.358868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.363770] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1050.363770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.365588] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: IN_PROGRESS for 2s [ 1050.435418] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82beedde-2995-4913-bbdf-905687660aa8 [ 1050.435710] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.435874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.436022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.436276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.436459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.436459] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82beedde-2995-4913-bbdf-905687660aa8 already deleted. [ 1050.438975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82beedde-2995-4913-bbdf-905687660aa8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.490882] env[65161]: INFO networking_nsxv3.common.synchronization [req-80dc098b-c060-4d61-ab30-088dbe9aac70 req-777d8875-a029-4710-bfd8-776b9045b604 tempest-ServerRescueTestJSON-311666717 tempest-ServerRescueTestJSON-311666717-project-member] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1050.491568] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1050.492500] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.493688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.493688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.493688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.493688] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.494941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.494941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.494941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.494941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.494941] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.566309] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.566309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.566563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.566600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.581677] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1050.586319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.590433] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1050.590433] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6815e7f8-d060-497e-9594-0ed8cadfdffe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.623616] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.623799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.623899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.624650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.639614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.640086] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1050.640225] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1050.640332] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1050.687191] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.687191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.687191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.687191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.688021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.688209] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1050.767242] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.767924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.767924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.767924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.768314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.768726] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1050.873901] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.875031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.875031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.875031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.875031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.875031] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1050.875247] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'06d910b0-5a99-40f2-ba32-49a643c7766c', 'b51ab0e8-12bd-4de0-9195-4b7a1c129654', '6e78a476-55e3-4a4a-ac0a-0627c95c4cfa', 'aeec6a6a-0263-4e7c-aea8-f50dc769d7fd', '0f1353e5-c7c0-46f0-b429-63bae5bf6d1f', 'dc66db19-7999-452e-b762-48cc852535e7', 'd21165f7-b2bc-43ce-8cb7-61f74b45df43', '2c187a3f-ed28-483a-9906-11a9f2cce3f3', '64d87f90-5895-4771-acb4-8aaeff02c417', '31b969f0-436d-400e-8475-a05d3168335c', '22b5f607-a69e-46b7-93e8-49d4437a6864', '403126a0-3b4c-4623-8ce4-c311b9739fcb', '07ad3588-f61e-418d-9a8e-c65add44c1be', '37b81f40-c340-4f5d-8250-ce4f8efa78fe', '059fa2a0-aacc-4252-8c71-d7658bfb6fb6', '200ba9e0-f56c-4b5d-9e39-69a507140fda', '06af9b92-f2b2-48b1-bf38-8ca0713490e4', '0f6a93f2-4e06-4cd8-9bde-77501efa88f4', '39430947-bbef-4608-bea6-00bd7d06d13b', '7caaaa94-1988-4a64-baf8-2e9ad4c3a553', 'f3e3e485-b210-4594-a46e-85922cc804cf', '68ff1a7f-59cd-4081-9af0-9322734ba92b', '5eae70bb-b2d5-4683-837e-e701a57929f1', 'dad00945-a380-4452-8a37-64cfdbf9d432', '20c8c1aa-e142-4f0d-9654-9180daa1078e', '490d862d-f7b2-497d-912a-e1801d9b16ad', '1d23f6bd-c3d6-4abc-b853-77560027d5d9', '48e5829e-83e0-44d7-b9e9-c3210ec30d0d', '9806617c-3cbb-4c3f-98c8-9af6c5b4dc39', '70c8e546-9b00-4441-97c1-cb8beb5cab1f', '2ba62457-a546-42c0-916a-d1efa9c77ee4', 'c38cb053-aec9-4ead-86a8-4aa3f2154903', 'cb265379-c4fb-47cf-afb5-2c655df91dbf', 'cc716056-e80f-437c-a978-42b0cd24b9c7', '1b4da512-0ef0-4e5a-aad1-7eff0f72d14f', 'e24f796e-b77b-42f0-a7c2-ae92228b28c5', '45c3c240-33f4-4e4c-b0dc-526406810cce', 'aa3f13db-d36f-47b7-bca4-30b32f714725', '28f6a198-5899-42cf-bfcf-d51f32053a44', 'b59bd654-2015-4855-bb01-60ad0a84a0b0', 'bb437f4e-1421-44f7-a301-63abddb16aa0', 'd592aa9d-8cc0-42f6-959d-30654012ec4e', 'c9f4e7d3-15ff-431e-9c10-7ea15b2417ee', 'e6704a80-3529-40ab-83a5-1a8a6167b498'} {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1050.875247] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1050.879425] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-697 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.879614] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-697" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.879984] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-697" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.880097] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-697" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.880500] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.880755] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.880928] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.881261] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.881527] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.881867] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.882066] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.882250] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.882427] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.882604] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.882780] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.882972] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.912029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.912198] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.912349] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.912520] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-697" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.913063] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-01049e69-5212-4df8-afac-c527e3b2c316 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.913063] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-01049e69-5212-4df8-afac-c527e3b2c316" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.913201] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-01049e69-5212-4df8-afac-c527e3b2c316" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.914296] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-01049e69-5212-4df8-afac-c527e3b2c316" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.914490] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01049e69-5212-4df8-afac-c527e3b2c316',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.916894] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.917035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.917085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.917549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.917649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.917798] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1050.917890] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1050.917983] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1050.996262] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.996433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.996506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.996711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.997907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.998208] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1050.998290] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1050.998365] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1050.998433] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1050.998511] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1050.998583] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGH for action security_group_rules [ 1050.998662] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGH for action security_group_rules [ 1050.998728] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGH for action security_group_rules [ 1050.998790] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGH for action security_group_rules [ 1050.998850] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGH for action security_group_rules [ 1050.998911] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGH for action security_group_rules [ 1050.998971] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGH for action security_group_rules [ 1050.999044] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGH for action security_group_rules [ 1050.999107] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGH for action security_group_rules [ 1050.999197] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGH for action security_group_rules [ 1050.999238] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGH for action security_group_rules [ 1050.999272] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGH for action security_group_rules [ 1050.999332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGH for action security_group_rules [ 1050.999392] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGH for action security_group_rules [ 1050.999453] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGH for action security_group_rules [ 1050.999514] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGH for action security_group_rules [ 1050.999575] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGH for action security_group_rules [ 1050.999638] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGH for action security_group_rules [ 1050.999701] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGH for action security_group_rules [ 1050.999764] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGH for action security_group_rules [ 1050.999861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.000131] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.092056] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.092218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.092284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.092441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.092530] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.092629] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe is going to be created. [ 1051.115953] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.117837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.117837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.117837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.117837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.129302] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe in Status: UNINITIALIZED for 2s [ 1051.367561] env[65161]: INFO networking_nsxv3.common.synchronization [None req-26459f52-9dc1-4bac-9238-967c78b5e35b tempest-ServersV294TestFqdnHostnames-2030996159 tempest-ServersV294TestFqdnHostnames-2030996159-project-member] Enqueued Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGH for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGH for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGH for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 with Priority: HIGH for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGH for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39430947-bbef-4608-bea6-00bd7d06d13b with Priority: HIGH for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGH for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 with Priority: HIGH for action security_group_rules [ 1051.369125] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe with Priority: HIGH for action security_group_rules [ 1051.369714] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGH for action security_group_rules [ 1051.369714] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGH for action security_group_rules [ 1051.369714] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb with Priority: HIGH for action security_group_rules [ 1051.369841] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 with Priority: HIGH for action security_group_rules [ 1051.371182] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b969f0-436d-400e-8475-a05d3168335c with Priority: HIGH for action security_group_rules [ 1051.371346] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGH for action security_group_rules [ 1051.371843] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc66db19-7999-452e-b762-48cc852535e7 with Priority: HIGH for action security_group_rules [ 1051.371843] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGH for action security_group_rules [ 1051.372038] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f with Priority: HIGH for action security_group_rules [ 1051.372038] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 with Priority: HIGH for action security_group_rules [ 1051.372274] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd with Priority: HIGH for action security_group_rules [ 1051.372800] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.373069] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.373172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.373575] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.373788] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.377247] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.377377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.377445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.377724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.377724] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.378595] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.378978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.379104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.380609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.380609] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.380609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.380609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.380609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.380609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.380609] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.381416] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.381416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.381578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.381638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.381695] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('059fa2a0-aacc-4252-8c71-d7658bfb6fb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.383052] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.383052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.383052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.383052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.383052] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.384778] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39430947-bbef-4608-bea6-00bd7d06d13b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.384778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.384778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.384778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.384778] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39430947-bbef-4608-bea6-00bd7d06d13b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.385620] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.385620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.385620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.385620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.385857] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.386597] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.386709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.386977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.386977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.387508] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06af9b92-f2b2-48b1-bf38-8ca0713490e4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.387737] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.387852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.388454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.388454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.388454] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37b81f40-c340-4f5d-8250-ce4f8efa78fe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.388926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.389089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.389213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.389462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.389462] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.391052] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.391052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.391052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.391052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.391052] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.393592] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-403126a0-3b4c-4623-8ce4-c311b9739fcb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.393592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.393592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.393592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.393592] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('403126a0-3b4c-4623-8ce4-c311b9739fcb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.394520] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b5f607-a69e-46b7-93e8-49d4437a6864 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.394641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.394696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.394864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.394939] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b5f607-a69e-46b7-93e8-49d4437a6864',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.395635] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31b969f0-436d-400e-8475-a05d3168335c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.395725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.395807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.395979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.396127] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31b969f0-436d-400e-8475-a05d3168335c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.398182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.398182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.398182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.398182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.398182] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.398182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc66db19-7999-452e-b762-48cc852535e7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.398182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.398182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.398838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.398838] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc66db19-7999-452e-b762-48cc852535e7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.398979] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.399073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.399142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.399272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.399339] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.399992] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.400147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.400188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.400385] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.400465] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f1353e5-c7c0-46f0-b429-63bae5bf6d1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.401255] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.401364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.401427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.401601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.401688] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b51ab0e8-12bd-4de0-9195-4b7a1c129654',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.402393] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.402502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.402869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.402869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.402869] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aeec6a6a-0263-4e7c-aea8-f50dc769d7fd',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.420281] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.421085] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.421085] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.421085] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.421085] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.421227] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 01049e69-5212-4df8-afac-c527e3b2c316 not found, creating... [ 1051.421459] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.421634] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.421746] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.421968] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.422112] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.422438] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.422638] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.422784] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.422931] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.423109] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.423458] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 01049e69-5212-4df8-afac-c527e3b2c316 is going to be created. [ 1051.459928] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.460492] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.460824] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.461165] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.461638] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.461842] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-01049e69-5212-4df8-afac-c527e3b2c316" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.504854] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.512269] env[65161]: INFO networking_nsxv3.common.synchronization [None req-fe390182-5383-479c-8dc5-057e376ef103 tempest-ServersV294TestFqdnHostnames-2030996159 tempest-ServersV294TestFqdnHostnames-2030996159-project-member] Enqueued Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_rules [ 1051.515520] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_rules [ 1051.515520] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.515520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.848415] env[65161]: INFO networking_nsxv3.common.synchronization [None req-210266ee-5741-4822-a673-c213f4bc2609 None None] Enqueued Resource ID: 0ad206aa-4fc0-4b3a-af38-8f5b987b21d5 with Priority: HIGHEST for action port [ 1051.849492] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad206aa-4fc0-4b3a-af38-8f5b987b21d5 with Priority: HIGHEST for action port [ 1051.849926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ad206aa-4fc0-4b3a-af38-8f5b987b21d5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.850090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ad206aa-4fc0-4b3a-af38-8f5b987b21d5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.850190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ad206aa-4fc0-4b3a-af38-8f5b987b21d5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.850527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ad206aa-4fc0-4b3a-af38-8f5b987b21d5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.850629] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ad206aa-4fc0-4b3a-af38-8f5b987b21d5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.907083] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.907898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.907898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.907898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.907898] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.907898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.907898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.908330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.908330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.908401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.908533] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.917111] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.917111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.917111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.917111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.917111] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.917111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.917111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.917111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.917520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.917520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.917520] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.921565] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.921565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.921565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.921565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.921900] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.921900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.922013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.922354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.922499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.922631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.922763] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.926542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.926542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.928640] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.928870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.929496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.929496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.929496] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.929496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.930231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.930351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.930451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.930585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.930739] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.931906] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.932171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.932288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.932547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.933128] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.933128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.933128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.933400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.933515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.933729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.934669] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.935358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.935609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.936043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.936209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.936978] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.936978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.936978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.937372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.937372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.937733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.937964] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.008442] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.010422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.010422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.010422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.010422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.010422] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be updated. [ 1052.019084] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.019335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.019437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.019692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.021587] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.021769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.022636] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.022777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.023541] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.023697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.024483] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.025252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.026696] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.026794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.027952] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.028125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.028926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.029039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.029698] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.029790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.030545] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.030645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.032100] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.032258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.033195] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.033832] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.034081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.035580] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.036086] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.036404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.037941] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.038513] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.038632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.039507] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.039854] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1052.040092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.040963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.040963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.040963] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.040963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.040963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.041781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.041781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.041781] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.059536] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.060303] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.061227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.061227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.061227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.061227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.063972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.064154] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be deleted. [ 1052.065539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.066428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.073374] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: IN_PROGRESS for 2s [ 1052.089104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.089104] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b5f607-a69e-46b7-93e8-49d4437a6864 is going to be deleted. [ 1052.092267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.092267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.108788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.108936] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39430947-bbef-4608-bea6-00bd7d06d13b is going to be deleted. [ 1052.109926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.110177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.133590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.133954] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b51ab0e8-12bd-4de0-9195-4b7a1c129654 is going to be deleted. [ 1052.140211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.140211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.145277] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.145601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.187529] env[65161]: INFO networking_nsxv3.common.synchronization [req-80dc098b-c060-4d61-ab30-088dbe9aac70 req-bfe73848-8f98-44ed-b4b7-cc68006b86b4 service nova] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_rules [ 1052.187761] env[65161]: INFO networking_nsxv3.common.synchronization [req-80dc098b-c060-4d61-ab30-088dbe9aac70 req-bfe73848-8f98-44ed-b4b7-cc68006b86b4 service nova] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1052.187970] env[65161]: INFO networking_nsxv3.common.synchronization [req-80dc098b-c060-4d61-ab30-088dbe9aac70 req-bfe73848-8f98-44ed-b4b7-cc68006b86b4 service nova] Enqueued Resource ID: 01049e69-5212-4df8-afac-c527e3b2c316 with Priority: HIGHEST for action port [ 1052.188792] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_rules [ 1052.189026] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1052.189133] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01049e69-5212-4df8-afac-c527e3b2c316 with Priority: HIGHEST for action port [ 1052.190674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.190825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.191052] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.191155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.191337] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-01049e69-5212-4df8-afac-c527e3b2c316 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.191470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01049e69-5212-4df8-afac-c527e3b2c316" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.191510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01049e69-5212-4df8-afac-c527e3b2c316" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.191777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01049e69-5212-4df8-afac-c527e3b2c316" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.191950] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01049e69-5212-4df8-afac-c527e3b2c316',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.255137] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.255317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.272234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.272453] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06af9b92-f2b2-48b1-bf38-8ca0713490e4 is going to be deleted. [ 1052.273816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.274107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.296583] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.296583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.342243] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.342386] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc66db19-7999-452e-b762-48cc852535e7 is going to be deleted. [ 1052.343360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.343589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.353126] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ad206aa-4fc0-4b3a-af38-8f5b987b21d5 [ 1052.353372] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.353510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.353587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.353894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.353980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.354093] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ad206aa-4fc0-4b3a-af38-8f5b987b21d5 already deleted. [ 1052.354174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ad206aa-4fc0-4b3a-af38-8f5b987b21d5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.368550] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.368733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.382180] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee in Status: SUCCESS [ 1052.382386] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9f4e7d3-15ff-431e-9c10-7ea15b2417ee deletion is rescheduled due to dependency. [ 1052.382512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9f4e7d3-15ff-431e-9c10-7ea15b2417ee" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.391812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.391992] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be deleted. [ 1052.393707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.393707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.413716] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.413851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.413982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.414161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.414579] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.414579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.414579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.415044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.415044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.415166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.415221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.415314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.415378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.415510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.415652] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.415785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.415829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.415972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.416083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.416125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.416216] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.445338] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.447092] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.447500] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.449639] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.449780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.449852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.450094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.450456] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.450456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.450456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.450643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.450728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.450775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.451312] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.451312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.451312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.451312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.451565] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.451565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.451565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.451719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.451796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.451877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.451963] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.453091] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.461784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.461784] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f1353e5-c7c0-46f0-b429-63bae5bf6d1f is going to be deleted. [ 1052.463589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.464448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.474373] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.474750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.475752] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.475869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.494163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.494163] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 059fa2a0-aacc-4252-8c71-d7658bfb6fb6 is going to be deleted. [ 1052.494163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.494163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.494163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.494163] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 already deleted. [ 1052.494163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.494163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.495677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.496964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.497663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.497845] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.543853] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.544077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.549222] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.549474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.550648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.550792] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 403126a0-3b4c-4623-8ce4-c311b9739fcb is going to be deleted. [ 1052.551789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.552014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.571130] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.571130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.594689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.594864] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37b81f40-c340-4f5d-8250-ce4f8efa78fe is going to be deleted. [ 1052.595893] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.597017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.624403] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.624533] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aeec6a6a-0263-4e7c-aea8-f50dc769d7fd is going to be deleted. [ 1052.625425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.625646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.637579] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.637579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.641296] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.641440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.694851] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01049e69-5212-4df8-afac-c527e3b2c316 with status ACTIVE [ 1052.694851] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.694851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.694851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.695191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.695229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.695416] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.696045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.696045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.696045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.696045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.696045] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.696045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.696353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.696353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.696353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.696443] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01049e69-5212-4df8-afac-c527e3b2c316 is going to be updated. [ 1052.709917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.710063] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31b969f0-436d-400e-8475-a05d3168335c is going to be deleted. [ 1052.710992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.711217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.711309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.711484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.711664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.711862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.711941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.712505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b5f607-a69e-46b7-93e8-49d4437a6864" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.712953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.713141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.713224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.713346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39430947-bbef-4608-bea6-00bd7d06d13b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.713485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.713690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.713770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.713883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b51ab0e8-12bd-4de0-9195-4b7a1c129654" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.714024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.714171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.714249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.714357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc66db19-7999-452e-b762-48cc852535e7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.714483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.714638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.714722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.714839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06af9b92-f2b2-48b1-bf38-8ca0713490e4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.715106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.715163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.715197] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.715401] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.715517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.715579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.715724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.715790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.716238] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be deleted. [ 1052.716810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.716969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.717067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.717244] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.717324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.717687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.717687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.717780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f1353e5-c7c0-46f0-b429-63bae5bf6d1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.718269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.718448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.718492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.718599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-059fa2a0-aacc-4252-8c71-d7658bfb6fb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.718727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.718864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.719044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.719158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-403126a0-3b4c-4623-8ce4-c311b9739fcb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.737590] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.737590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.737590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.738060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.738149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.738283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01049e69-5212-4df8-afac-c527e3b2c316" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.772244] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.772495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.772495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.772613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.772667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.773718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aeec6a6a-0263-4e7c-aea8-f50dc769d7fd" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.788270] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.788455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.788529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.788744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.788827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.788954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37b81f40-c340-4f5d-8250-ce4f8efa78fe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.816840] env[65161]: INFO networking_nsxv3.common.synchronization [req-9c0b31bc-b032-4879-85d7-bb9975621e00 req-97baed7a-5a57-4768-ab0f-1ff300c20a32 tempest-ImagesOneServerNegativeTestJSON-1819154006 tempest-ImagesOneServerNegativeTestJSON-1819154006-project-member] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1052.817461] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1052.817949] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.817949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.818112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.818206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.818359] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.818463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.818526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.818655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.818732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.818856] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.831571] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.831789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.831880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.832174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.832174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.832288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.849771] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.851190] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.851190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.851190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.851190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.851190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.851586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31b969f0-436d-400e-8475-a05d3168335c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.922136] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ad3588-f61e-418d-9a8e-c65add44c1be: rpc.has_security_group_logging(os_id): False [ 1052.949729] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.950526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.950526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.950526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.951850] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d910b0-5a99-40f2-ba32-49a643c7766c: rpc.has_security_group_logging(os_id): False [ 1052.953157] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d21165f7-b2bc-43ce-8cb7-61f74b45df43: rpc.has_security_group_logging(os_id): False [ 1052.954287] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64d87f90-5895-4771-acb4-8aaeff02c417: rpc.has_security_group_logging(os_id): False [ 1052.955471] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caaaa94-1988-4a64-baf8-2e9ad4c3a553: rpc.has_security_group_logging(os_id): False [ 1052.956485] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c187a3f-ed28-483a-9906-11a9f2cce3f3: rpc.has_security_group_logging(os_id): False [ 1052.991242] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.991447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.998594] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.998594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.002038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.002038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.003266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.004065] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.004459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.004803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.005139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.005345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.005688] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.005917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.006163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.006437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.010020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.010020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.010020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.010020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.010020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.010020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.010020] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1053.010020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.010020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.011974] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.012699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.014373] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.014872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.043272] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.043272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.048400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.049080] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.052551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.052649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.052866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.052957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.053082] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be updated. [ 1053.058911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.058911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.083705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.084061] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.084193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.084236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.084909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.084909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.084909] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 is going to be updated. [ 1053.086413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.086413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.108071] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.108217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.112777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.115672] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.115672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.115672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.115672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.115672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.115672] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 is going to be updated. [ 1053.118214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.118214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.118214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.118464] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 already deleted. [ 1053.118464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.118464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.118651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.148714] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe in Status: SUCCESS [ 1053.148888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.149634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.149634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.149634] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.149634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.149798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.149850] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.149886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.151308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.151308] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6815e7f8-d060-497e-9594-0ed8cadfdffe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.151964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.152511] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.152623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.153755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.153755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.153755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.153755] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c is going to be updated. [ 1053.155075] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.156052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.156052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.156052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.156052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.156649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.156805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.156878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.158141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.158348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.167967] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.168125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.176111] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64d87f90-5895-4771-acb4-8aaeff02c417 in Status: IN_PROGRESS for 2s [ 1053.177509] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1053.196633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.197107] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.197315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.197429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.198685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.198685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.199011] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.199011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.199011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.199246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.199338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.199616] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.199680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.199779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.199936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.200033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.200214] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1053.201775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.201775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.202051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.261459] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: IN_PROGRESS for 2s [ 1053.282539] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.282729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.282815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.283109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.283328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.297312] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.297500] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.297500] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.297762] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.298234] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.298413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.298413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.298665] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.298812] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.299039] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.299163] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.299271] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.299373] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.299540] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.299634] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.299838] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.304333] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.304569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.304569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.304779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.304970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.320167] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 in Status: IN_PROGRESS for 2s [ 1053.320929] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.321099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.321173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.321424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.345185] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d910b0-5a99-40f2-ba32-49a643c7766c in Status: IN_PROGRESS for 2s [ 1053.375330] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.375532] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.076 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.375708] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.375989] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-684" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.376383] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.376598] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.376736] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.377182] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.377341] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a66da5ba-2885-4d60-8efa-ba2d7caadb9b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.385493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.385674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.385791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.385846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.386110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.386219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.386333] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 1053.435298] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.435463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.435529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.435716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.435871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.450324] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.450324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.450324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.450324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.450324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.460753] env[65161]: INFO networking_nsxv3.common.synchronization [req-9bb1e330-1e3b-4a2c-877d-73e468a14e2e req-bf117a5f-4604-47c0-b866-862bd9cc3ec5 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_members [ 1053.461230] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGHEST for action security_group_members [ 1053.461572] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ba62457-a546-42c0-916a-d1efa9c77ee4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.461785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.461863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.462133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.462261] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.462358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.462425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.462583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.462681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.462775] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.470800] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 1053.509690] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1053.660601] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6815e7f8-d060-497e-9594-0ed8cadfdffe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.661486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.661486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.661486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.661486] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.661727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.661727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.661898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.661990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.662100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.662254] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6815e7f8-d060-497e-9594-0ed8cadfdffe taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.662345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.662405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.662676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.662676] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.662829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.662829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.662959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.663047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.663131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.663222] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6815e7f8-d060-497e-9594-0ed8cadfdffe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.881150] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.881150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.881150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.881150] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.881379] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.881379] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port a66da5ba-2885-4d60-8efa-ba2d7caadb9b not found, creating... [ 1053.881566] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.882131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.882131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.882131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.882297] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.882453] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.882597] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.882705] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.882902] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.884024] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.884024] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: a66da5ba-2885-4d60-8efa-ba2d7caadb9b is going to be created. [ 1053.906542] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.906832] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.906973] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.907313] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.907544] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.908592] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.969632] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.969632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.969632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.969632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.993411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.993411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.993722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.993722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.993876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.993962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.994071] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 is going to be updated. [ 1054.037062] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.037255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.037326] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.037554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.037729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.048012] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 in Status: IN_PROGRESS for 2s [ 1054.085417] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: SUCCESS [ 1054.085637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.085807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.086367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.086367] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.086367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.086533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.086565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.086646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.086731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.086866] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.090029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.090213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.090384] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.090753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.090753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.090753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.090873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.090873] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.165236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6815e7f8-d060-497e-9594-0ed8cadfdffe: rpc.has_security_group_logging(os_id): False [ 1054.184911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.185083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.185136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.185353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.185698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.185698] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.185824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.185824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.186020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.186144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.186395] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.186487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.186566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.186934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.186934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.187102] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.187199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.187265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.187526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.187526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.187629] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe is going to be created. [ 1054.253300] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.253524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.253524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.254588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.254588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.274035] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe in Status: IN_PROGRESS for 2s [ 1054.361029] env[65161]: INFO networking_nsxv3.common.synchronization [req-13648dd2-58d4-4461-a94e-5dc187cf4fea req-fe91fa4e-ef3b-4ce5-97e9-91859146a9a9 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1054.361517] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1054.365187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.365315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.365396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.365710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.365867] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.365975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.366050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.366206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.366295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.366392] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.576042] env[65161]: INFO networking_nsxv3.common.synchronization [req-9c0b31bc-b032-4879-85d7-bb9975621e00 req-415a9bbf-e6df-484c-b961-5c0a49a24640 service nova] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_rules [ 1054.576364] env[65161]: INFO networking_nsxv3.common.synchronization [req-9c0b31bc-b032-4879-85d7-bb9975621e00 req-415a9bbf-e6df-484c-b961-5c0a49a24640 service nova] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1054.576364] env[65161]: INFO networking_nsxv3.common.synchronization [req-9c0b31bc-b032-4879-85d7-bb9975621e00 req-415a9bbf-e6df-484c-b961-5c0a49a24640 service nova] Enqueued Resource ID: a66da5ba-2885-4d60-8efa-ba2d7caadb9b with Priority: HIGHEST for action port [ 1054.577262] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_rules [ 1054.577432] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1054.577707] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a66da5ba-2885-4d60-8efa-ba2d7caadb9b with Priority: HIGHEST for action port [ 1054.578105] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.578231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.578318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.578492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.578583] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.580211] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.580372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.580610] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.580783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.580884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.581112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.581252] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a66da5ba-2885-4d60-8efa-ba2d7caadb9b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.590542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.591176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.592776] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.869869] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.080674] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.080765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.083223] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a66da5ba-2885-4d60-8efa-ba2d7caadb9b with status ACTIVE [ 1055.084181] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.084181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.084181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.084181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.084181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.084181] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.084181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.084442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.084442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.084442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.084633] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.084765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.084824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.084946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.085033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.085118] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a66da5ba-2885-4d60-8efa-ba2d7caadb9b is going to be updated. [ 1055.095802] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.110339] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.110525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.110596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.110811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.110951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.111332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a66da5ba-2885-4d60-8efa-ba2d7caadb9b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.193952] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1055.194293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.195179] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64d87f90-5895-4771-acb4-8aaeff02c417 in Status: SUCCESS [ 1055.195259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.275581] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 1055.275802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.345236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 in Status: SUCCESS [ 1055.345236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.358690] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d910b0-5a99-40f2-ba32-49a643c7766c in Status: SUCCESS [ 1055.358926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.372309] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.483306] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 1055.483306] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e deletion is rescheduled due to dependency. [ 1055.483306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.483496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.483541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.483841] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.483971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.484047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.484252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.484352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.484467] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.528354] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1055.528601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.599783] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.600104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.600104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.600226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.600264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.600365] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be updated. [ 1055.642344] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.642344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.642344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.642344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.642344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.652506] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: IN_PROGRESS for 2s [ 1055.875018] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.875254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.875365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.875654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.875781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.875913] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1055.907320] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.907527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.907635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.907917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.908143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.919675] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1055.987083] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.058997] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 in Status: SUCCESS [ 1056.059314] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 deletion is rescheduled due to dependency. [ 1056.059452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.298029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe in Status: SUCCESS [ 1056.298268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.489163] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.992040] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.995222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.995222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.995222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.995222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995222] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 1057.024969] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.025222] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.025320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.025556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.025748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.034403] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 1057.664448] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: SUCCESS [ 1057.664676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.664857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.665106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.665305] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.665428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.665493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.665646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.665730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.665817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.665974] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.666173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.666255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.666399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.666543] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.666676] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.666724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.666842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.666919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.667012] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.667104] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.929538] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1057.929748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.169317] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa: rpc.has_security_group_logging(os_id): False [ 1058.187818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.187818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.187998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.188103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.207578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.207863] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.208009] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.208109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.208274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.208359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.208546] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.208644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.208704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.208857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.208955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.209168] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.209264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.209320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.209459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.209532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.209614] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be updated. [ 1058.274821] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.274992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.275081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.275294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.275432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.289401] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: IN_PROGRESS for 2s [ 1059.045681] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 1059.045824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.045927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.046232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.046956] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.046956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.046956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.046956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.046956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.046956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.047518] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.551508] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.551508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.551508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.551921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.551921] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.551921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.552051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.552213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.552332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.552442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.552615] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.552744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.552878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.553075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.553258] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.553440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.553543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.553719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.553824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.553958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.554091] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.578998] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1059.579143] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1060.056484] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 20c8c1aa-e142-4f0d-9654-9180daa1078e: rpc.has_security_group_logging(os_id): False [ 1060.075188] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.075358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.075434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.075660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.075752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.075944] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.076057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.076111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.076266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.076358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.076553] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.076678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.076721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.076835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.076926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.077241] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.077388] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.077447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.077548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.077626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.077709] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 1060.140044] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.140044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.140272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.140347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.140532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.155162] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 1060.310346] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: SUCCESS [ 1060.310519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.311927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.311927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.311927] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.813274] env[65161]: INFO networking_nsxv3.common.synchronization [req-af671c7d-4494-4912-b4e7-91120b9201fc req-06665f69-8927-4945-848e-99dfb73aadad tempest-ServerTagsTestJSON-1123938404 tempest-ServerTagsTestJSON-1123938404-project-member] Enqueued Resource ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe with Priority: HIGHEST for action security_group_members [ 1060.814085] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.814381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.814551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.814850] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.815130] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.815352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.815520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.815763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.816051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.816274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.816458] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.817839] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe with Priority: HIGHEST for action security_group_members [ 1060.818470] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6815e7f8-d060-497e-9594-0ed8cadfdffe taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.818824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.818987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.820316] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.820316] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.820316] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.820316] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.820316] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.820316] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.820316] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6815e7f8-d060-497e-9594-0ed8cadfdffe',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.062078] env[65161]: INFO networking_nsxv3.common.synchronization [req-f27d9be5-e886-40c9-a6ef-feacb8ba27eb req-8d433906-64c7-4634-b5a0-3fd9cc6ce75e tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 1061.063219] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 1061.064284] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.064488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.064597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.065816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.065816] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.065816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.065816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.065816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.065816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.065816] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.319061] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.319274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.319325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.319522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.319695] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.319796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.319867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.319999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.320097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.320247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.320397] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.320492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.320550] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.320690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.320869] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.320920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.320962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.321095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.321170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.321248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.321336] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.322493] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.322646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.322736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.322912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.323024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.323223] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.323344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.324284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.324284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.324284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.324284] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe is going to be updated. [ 1061.351658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.351879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.351954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.352201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.352347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.363254] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe in Status: IN_PROGRESS for 2s [ 1061.415381] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-34 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.415571] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.415691] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.415956] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.416291] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.416484] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.416621] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.416869] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.417042] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.417256] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.417359] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.417462] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.417563] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.417665] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.417764] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.417887] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.441018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.441018] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1061.441018] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.441018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.441018] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.441018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.441018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.441018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.441018] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.571414] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.571414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.571414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.571414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.610853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.611076] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.611206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.611272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.611493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.611579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.611716] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 1061.652062] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.652062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.652062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.652062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.652062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.670328] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 1061.826444] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa: rpc.has_security_group_logging(os_id): False [ 1061.845540] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.849797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.849797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.849797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.850638] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.850638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.850638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.850638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.850638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.850638] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be updated. [ 1061.894083] env[65161]: INFO networking_nsxv3.common.synchronization [req-3b3d275c-f41f-4182-ac5a-2f6322f88163 req-b2cac7c4-e626-4200-8eba-9a281c8c4b3e tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1061.894823] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1061.895429] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.895555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.895555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.895812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.896014] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.896172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.896309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.896576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.896748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.896931] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.914486] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.914638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.914711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.916169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.916169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.931515] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: IN_PROGRESS for 2s [ 1061.942570] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.942820] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.942933] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.943404] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.943404] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.943662] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.943917] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.944153] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.944413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.944546] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.945291] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.945479] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.945602] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.945820] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.945964] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.946117] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 is going to be updated. [ 1061.996839] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.996839] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.996994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.997239] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.997442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.997668] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.174146] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 1062.174146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.400501] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.400657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.400728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.400939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.401048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.401260] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.401361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.401420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.401574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.401765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.401765] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1062.432717] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.432717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.432959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.432959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.433219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.443465] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1062.681379] env[65161]: INFO networking_nsxv3.common.synchronization [req-8f8b2e7c-bad4-4e4b-b26c-f6482833be26 req-7010bade-64f9-4678-8298-b0a49c84e27f service nova] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_rules [ 1062.681379] env[65161]: INFO networking_nsxv3.common.synchronization [req-8f8b2e7c-bad4-4e4b-b26c-f6482833be26 req-7010bade-64f9-4678-8298-b0a49c84e27f service nova] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 1062.681379] env[65161]: INFO networking_nsxv3.common.synchronization [req-8f8b2e7c-bad4-4e4b-b26c-f6482833be26 req-7010bade-64f9-4678-8298-b0a49c84e27f service nova] Enqueued Resource ID: dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 with Priority: HIGHEST for action port [ 1062.681687] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_rules [ 1062.681957] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 1062.682109] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 with Priority: HIGHEST for action port [ 1062.682364] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.682484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.682546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.682753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.682831] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.683720] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.683887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.683950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.684149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.684309] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.684885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.684974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.685156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.685241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.685341] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.687689] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.688468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.688564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.688742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.689030] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.190823] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.192403] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.192549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.192767] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 with status ACTIVE [ 1063.192912] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.193028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.193098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.193260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.193422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.193556] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.193652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.193723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.193899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.193999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.195128] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.195549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.195549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.195690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.195690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.195824] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0 is going to be updated. [ 1063.221500] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.221500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.221500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.221500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.221500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.221500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbd25baa-9a3d-4ade-95eb-bc18cdbbf5b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.373958] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe in Status: SUCCESS [ 1063.374201] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6815e7f8-d060-497e-9594-0ed8cadfdffe deletion is rescheduled due to dependency. [ 1063.374320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6815e7f8-d060-497e-9594-0ed8cadfdffe" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.682167] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 1063.682400] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 1063.682616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.698647] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.945332] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: SUCCESS [ 1063.945479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.200575] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.200903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.200903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.203625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.203759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.203892] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be updated. [ 1064.234109] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.234330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.234330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.234561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.235376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.244913] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 2s [ 1064.310304] env[65161]: INFO networking_nsxv3.common.synchronization [req-2e1fed9f-228d-44d3-b8f7-c3f91c52b3f1 req-9780608c-0711-4b02-9a40-f5c9a7ef030f tempest-ServersV294TestFqdnHostnames-2030996159 tempest-ServersV294TestFqdnHostnames-2030996159-project-member] Enqueued Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_members [ 1064.317797] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_members [ 1064.317797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.317797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.317797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.317797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.317797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.317797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.317797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.317797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.317797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.317797] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.456893] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1064.456893] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1064.456893] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.707436] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.707436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-473" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.707436] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-473" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.707794] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-473" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.707794] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.708511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.708511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.708511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.708511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.708669] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.708709] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.709920] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.709920] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.709920] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.709920] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.709920] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.731022] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.731022] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1064.731022] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.731022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-473" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.731022] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-e0a42bf3-8010-45be-9320-0c8f0e459cac taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.731022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-e0a42bf3-8010-45be-9320-0c8f0e459cac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.731022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-e0a42bf3-8010-45be-9320-0c8f0e459cac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.731022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-e0a42bf3-8010-45be-9320-0c8f0e459cac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.731022] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0a42bf3-8010-45be-9320-0c8f0e459cac',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.819735] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.819881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.819950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.820186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.821018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.821018] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.821018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.821018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.821018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.821018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.821018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 already deleted. [ 1064.821018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.234108] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.234489] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.234603] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.235054] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.235323] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.235525] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port e0a42bf3-8010-45be-9320-0c8f0e459cac not found, creating... [ 1065.235900] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.236131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.236356] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.236619] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.236764] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.237069] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.237255] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.237374] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.237582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.237715] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.237858] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: e0a42bf3-8010-45be-9320-0c8f0e459cac is going to be created. [ 1065.263563] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.263563] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.263824] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.264846] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.264846] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.264846] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-e0a42bf3-8010-45be-9320-0c8f0e459cac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.033626] env[65161]: INFO networking_nsxv3.common.synchronization [req-2e1fed9f-228d-44d3-b8f7-c3f91c52b3f1 req-95b2f7e6-d7f5-4110-a7d3-c2b91ff75581 service nova] Enqueued Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_rules [ 1066.033978] env[65161]: INFO networking_nsxv3.common.synchronization [req-2e1fed9f-228d-44d3-b8f7-c3f91c52b3f1 req-95b2f7e6-d7f5-4110-a7d3-c2b91ff75581 service nova] Enqueued Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_members [ 1066.034242] env[65161]: INFO networking_nsxv3.common.synchronization [req-2e1fed9f-228d-44d3-b8f7-c3f91c52b3f1 req-95b2f7e6-d7f5-4110-a7d3-c2b91ff75581 service nova] Enqueued Resource ID: e0a42bf3-8010-45be-9320-0c8f0e459cac with Priority: HIGHEST for action port [ 1066.035157] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_rules [ 1066.035384] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_members [ 1066.035578] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a42bf3-8010-45be-9320-0c8f0e459cac with Priority: HIGHEST for action port [ 1066.036205] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.036306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.036429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.036978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.036978] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.038689] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.038689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.038689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.039981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.040443] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.040443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.040443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.040652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.040758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.040794] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.042155] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0a42bf3-8010-45be-9320-0c8f0e459cac taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.042296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0a42bf3-8010-45be-9320-0c8f0e459cac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.042396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0a42bf3-8010-45be-9320-0c8f0e459cac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.042892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0a42bf3-8010-45be-9320-0c8f0e459cac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.042892] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0a42bf3-8010-45be-9320-0c8f0e459cac',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.256787] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 1066.256787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.256787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.256787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.256787] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.256787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.256787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.256787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.256787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.256787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.256787] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.544835] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.545047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.545282] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.546266] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0a42bf3-8010-45be-9320-0c8f0e459cac with status ACTIVE [ 1066.546473] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.546578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.546648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.546867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.546972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.547200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.547317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.547397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.547570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.547653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.550876] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.550876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.550876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.550876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.550876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.550876] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0a42bf3-8010-45be-9320-0c8f0e459cac is going to be updated. [ 1066.576924] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.577098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.577098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.577355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.577508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.577735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0a42bf3-8010-45be-9320-0c8f0e459cac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.759024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.759174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.759174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.759427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.759670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.759798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.759882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.760128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.760254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.760356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.760514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.760673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.760673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.760803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.761025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.761077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.761111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.761335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.761335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.761427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.761504] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.056021] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.264420] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3e3e485-b210-4594-a46e-85922cc804cf: rpc.has_security_group_logging(os_id): False [ 1067.283749] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.284013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.284154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.284493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.306548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.306548] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.306922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.307033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.308061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.308061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.308061] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.308061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.308061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.308387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.308387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.308641] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.308814] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.308910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.309158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.309295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.309429] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be updated. [ 1067.385583] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.385753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.385821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.386036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.386225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.393035] env[65161]: INFO networking_nsxv3.common.synchronization [req-d8bd00c7-65c5-4ab3-b434-5a2b993cbc6c req-181fb8d9-5d56-4a4e-bd02-2793170b363e tempest-ImagesOneServerNegativeTestJSON-1819154006 tempest-ImagesOneServerNegativeTestJSON-1819154006-project-member] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1067.393035] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGHEST for action security_group_members [ 1067.393415] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.393524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.393696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.393972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.394182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.394258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.394333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.394554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.394610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.394738] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.403609] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 2s [ 1067.527259] env[65161]: INFO networking_nsxv3.common.synchronization [None req-b50cf617-6a16-49da-b015-64e033658948 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_rules [ 1067.527259] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_rules [ 1067.527715] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.527965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.528057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.528387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.528522] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.558635] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.558910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.559043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.559303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.559445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.559514] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 is going to be created. [ 1067.594519] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.594773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.594908] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.595439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.595669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.611114] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 in Status: UNINITIALIZED for 2s [ 1067.682318] env[65161]: INFO networking_nsxv3.common.synchronization [None req-b3bd8cc3-0d5e-4b90-8928-ccee9741ddf4 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_rules [ 1067.682318] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_rules [ 1067.682758] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.683056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.897656] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.897877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.897927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.898186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.898260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.898438] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.898573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.898671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.898846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.898922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.899025] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be updated. [ 1067.935202] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.935404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.935404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.935618] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.935766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.948440] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: IN_PROGRESS for 2s [ 1068.049669] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.049848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.049956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.050276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.050643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.050643] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 already deleted. [ 1068.050752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.050912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.051182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.051326] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.537426] env[65161]: INFO networking_nsxv3.common.synchronization [req-02ea6ccb-f695-4125-ad6a-d32d00e8be38 req-36b30597-c245-417d-8f62-8f744684f36d tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_members [ 1068.537906] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGHEST for action security_group_members [ 1068.541040] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.541040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.541040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.541040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.541040] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.541040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.541040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.541040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.541040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.541040] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.577226] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.577607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.579865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.580225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.580441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.580725] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 already deleted. [ 1068.581655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.043571] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.043571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.043571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.043746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.043746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.043918] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.044112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.044224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.044480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.044480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.044643] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 is going to be updated. [ 1069.078032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.078032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.078032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.078361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.078361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.089947] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 in Status: IN_PROGRESS for 2s [ 1069.419045] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 1069.419045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.621679] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 in Status: SUCCESS [ 1069.621994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.621994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.622671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.622671] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.622671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.622856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.622856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.623028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.623152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.623266] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.819358] env[65161]: INFO networking_nsxv3.common.synchronization [req-8fbf2aee-38fa-49c0-89cc-84371ee1689a req-d4f2631c-c0a0-448c-a813-b13160bd8352 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_members [ 1069.819781] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGHEST for action security_group_members [ 1069.820132] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.820256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.820322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.820536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.820695] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.820788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.820851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.821071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.821160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.821253] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.959690] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e in Status: SUCCESS [ 1069.959847] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e deletion is rescheduled due to dependency. [ 1069.959847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.157872] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.323485] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.323665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.323742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.323995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.325612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.325612] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.325612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.325612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.325612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.325612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.325612] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c is going to be updated. [ 1070.359810] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.359810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.359810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.359810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.359810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.370655] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d910b0-5a99-40f2-ba32-49a643c7766c in Status: IN_PROGRESS for 2s [ 1070.631459] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 715edd9d-de1e-4ad5-b572-5f9f1ef01e31: rpc.has_security_group_logging(os_id): False [ 1070.651411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.651597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.651668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.651914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.652123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.652434] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.652562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.652636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.652872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.652982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.653097] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 is going to be created. [ 1070.777664] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.777823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.777897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.778145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.778335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.796511] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 in Status: IN_PROGRESS for 2s [ 1070.800909] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ac165b7-080b-4a8a-a519-0748a6eab274 req-dfa5d2a8-2028-4dc6-ad2e-ebe68e4ce7a4 tempest-ListImageFiltersTestJSON-649465129 tempest-ListImageFiltersTestJSON-649465129-project-member] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1070.801579] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1070.801911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.802334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.802334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.802425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.802542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.802705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.802805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.803050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.803123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.804231] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.100120] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 in Status: SUCCESS [ 1071.100385] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 deletion is rescheduled due to dependency. [ 1071.100501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.114764] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.115026] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.115289] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.115561] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.115854] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.116026] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.116154] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.116367] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.116509] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.116708] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.116817] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.116943] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.117077] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.117193] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.117297] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.117426] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.139632] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.139843] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.140046] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.140273] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.140587] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.140767] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.140923] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.141275] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.141415] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8b38e8f-bc6d-4d32-968a-72b3b7958c02',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.305911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.306139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.306167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.306397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.306490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.306794] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.306981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.307143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.307212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.307357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.307455] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72c3d008-c3df-415c-97a1-58c326239709 already deleted. [ 1071.307573] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.643455] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.643827] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.643827] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.644091] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.644286] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.644449] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port d8b38e8f-bc6d-4d32-968a-72b3b7958c02 not found, creating... [ 1071.644705] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.644870] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.645021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.645388] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.645582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.645867] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.646039] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.646236] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.646481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.646622] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.646761] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: d8b38e8f-bc6d-4d32-968a-72b3b7958c02 is going to be created. [ 1071.666244] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.666413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.666536] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.666796] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.666994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.667239] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.382557] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d910b0-5a99-40f2-ba32-49a643c7766c in Status: SUCCESS [ 1072.382787] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c deletion is rescheduled due to dependency. [ 1072.382949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.411117] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ac165b7-080b-4a8a-a519-0748a6eab274 req-6729fb13-c7cb-46f6-9279-b6adcfe8a4db service nova] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_rules [ 1072.411204] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ac165b7-080b-4a8a-a519-0748a6eab274 req-6729fb13-c7cb-46f6-9279-b6adcfe8a4db service nova] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1072.411368] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ac165b7-080b-4a8a-a519-0748a6eab274 req-6729fb13-c7cb-46f6-9279-b6adcfe8a4db service nova] Enqueued Resource ID: d8b38e8f-bc6d-4d32-968a-72b3b7958c02 with Priority: HIGHEST for action port [ 1072.411939] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_rules [ 1072.412964] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1072.413121] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8b38e8f-bc6d-4d32-968a-72b3b7958c02 with Priority: HIGHEST for action port [ 1072.413426] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.413577] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.413606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.414485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.414485] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.416229] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.416402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.416495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.416756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.416936] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.419215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.419283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.419516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.419641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.419741] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.420914] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.421354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.421433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.421618] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.421721] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8b38e8f-bc6d-4d32-968a-72b3b7958c02',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.809248] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 in Status: SUCCESS [ 1072.809494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.924519] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.924685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.925635] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.925882] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8b38e8f-bc6d-4d32-968a-72b3b7958c02 with status ACTIVE [ 1072.926056] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.926187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.926259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.926477] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.926587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.926739] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.926836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.926897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.927688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.927808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.928320] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.928320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.928320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.928457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.928630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.928736] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8b38e8f-bc6d-4d32-968a-72b3b7958c02 is going to be updated. [ 1072.955487] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.955637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.955709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.955919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.956068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.956253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8b38e8f-bc6d-4d32-968a-72b3b7958c02" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.148596] env[65161]: INFO networking_nsxv3.common.synchronization [req-fddb7388-23f2-415a-82eb-9c36b63a4df3 req-2feaa82e-61dc-4d44-9e4e-37fb66f97abf tempest-ListImageFiltersTestJSON-649465129 tempest-ListImageFiltersTestJSON-649465129-project-member] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1073.149220] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1073.149564] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.149661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.433226] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.573736] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.574361] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.574361] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.574549] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.575227] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.575227] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.575227] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.575549] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.575748] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.575974] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.576106] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.576563] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.576812] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.576812] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.576929] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.577074] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.602298] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.602298] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.602298] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.602298] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.602615] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-eba0306b-c912-4950-b895-d8824a8117f3 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.602717] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-eba0306b-c912-4950-b895-d8824a8117f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.602877] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-eba0306b-c912-4950-b895-d8824a8117f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.604010] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-eba0306b-c912-4950-b895-d8824a8117f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.604010] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba0306b-c912-4950-b895-d8824a8117f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.938237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.938237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.938237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.938237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.938237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.938237] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72c3d008-c3df-415c-97a1-58c326239709 is going to be created. [ 1073.962216] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.962401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.962440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.962782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.962856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.972879] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: UNINITIALIZED for 2s [ 1074.105996] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.106267] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.106413] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.106706] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.106858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.107029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port eba0306b-c912-4950-b895-d8824a8117f3 not found, creating... [ 1074.107301] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.107463] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.107633] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.107941] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.108013] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.108306] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.108464] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.108581] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.108870] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.109098] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.109303] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: eba0306b-c912-4950-b895-d8824a8117f3 is going to be created. [ 1074.132103] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.132312] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.132355] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.132729] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.133321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.133973] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-eba0306b-c912-4950-b895-d8824a8117f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.861463] env[65161]: INFO networking_nsxv3.common.synchronization [req-fddb7388-23f2-415a-82eb-9c36b63a4df3 req-d25e22ba-6288-4672-b65d-90d991643c43 service nova] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_rules [ 1074.861794] env[65161]: INFO networking_nsxv3.common.synchronization [req-fddb7388-23f2-415a-82eb-9c36b63a4df3 req-d25e22ba-6288-4672-b65d-90d991643c43 service nova] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1074.862074] env[65161]: INFO networking_nsxv3.common.synchronization [req-fddb7388-23f2-415a-82eb-9c36b63a4df3 req-d25e22ba-6288-4672-b65d-90d991643c43 service nova] Enqueued Resource ID: eba0306b-c912-4950-b895-d8824a8117f3 with Priority: HIGHEST for action port [ 1074.862839] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_rules [ 1074.863087] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1074.863289] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba0306b-c912-4950-b895-d8824a8117f3 with Priority: HIGHEST for action port [ 1074.863792] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.863966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.864311] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.864437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.864735] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-eba0306b-c912-4950-b895-d8824a8117f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.864913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eba0306b-c912-4950-b895-d8824a8117f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.867816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eba0306b-c912-4950-b895-d8824a8117f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.867816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eba0306b-c912-4950-b895-d8824a8117f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.867816] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba0306b-c912-4950-b895-d8824a8117f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.368362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eba0306b-c912-4950-b895-d8824a8117f3 with status ACTIVE [ 1075.369285] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.369285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.369285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.369285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.369285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.369285] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.369873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.369873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.369873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.369873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.371341] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.371341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.371341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.371629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.371721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.371815] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eba0306b-c912-4950-b895-d8824a8117f3 is going to be updated. [ 1075.394544] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.394706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.394867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.395081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.395764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.395764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eba0306b-c912-4950-b895-d8824a8117f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.718461] env[65161]: INFO networking_nsxv3.common.synchronization [req-bdf497e9-4f37-4400-b973-c24eab5714cf req-8f97913c-843c-450c-ac14-808bbc7eb07f tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 1075.719701] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 1075.720073] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.720205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.720279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.720479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.720623] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.720722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.720784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.720929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.721036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.721140] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.985426] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: SUCCESS [ 1075.986378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.986378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.986378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.986378] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.986378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.986378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.986670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.986670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.986670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.986762] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.987682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.987849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.988025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.988265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.988265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.988431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.988512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.988600] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.223763] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.224089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.224237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.224599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.224783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.225141] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.225366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.225505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.225811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.226034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.226187] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 1076.235673] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.235746] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.236072] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.236230] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.236533] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.236705] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.236855] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.237381] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.237381] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.237475] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.237569] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.237675] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.238248] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.238248] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.238248] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.238467] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.263027] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.263355] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1076.263583] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.263847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-893" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.264448] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-8b8d0717-6834-44ee-b54e-4a189ddcd068 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.264720] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-8b8d0717-6834-44ee-b54e-4a189ddcd068" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.264929] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-8b8d0717-6834-44ee-b54e-4a189ddcd068" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.265542] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-8b8d0717-6834-44ee-b54e-4a189ddcd068" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.265768] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b8d0717-6834-44ee-b54e-4a189ddcd068',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.268976] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.268976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.268976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.268976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.269821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.282721] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 1076.490364] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.490762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.490906] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.773289] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.773619] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.773721] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.774125] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.774305] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.774492] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 8b8d0717-6834-44ee-b54e-4a189ddcd068 not found, creating... [ 1076.774813] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.775011] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.775144] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.775451] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.775614] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.777069] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.777232] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.777421] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.777818] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.778068] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.778355] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 8b8d0717-6834-44ee-b54e-4a189ddcd068 is going to be created. [ 1076.807151] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.807404] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.807548] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.807983] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.808420] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.809028] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-8b8d0717-6834-44ee-b54e-4a189ddcd068" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.993985] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.496960] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.497254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.497254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.497486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.497532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.497628] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72c3d008-c3df-415c-97a1-58c326239709 is going to be updated. [ 1077.530195] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.530457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.530457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.530711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.532040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.541555] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: IN_PROGRESS for 2s [ 1077.569105] env[65161]: INFO networking_nsxv3.common.synchronization [req-bdf497e9-4f37-4400-b973-c24eab5714cf req-c3dcec60-1a20-454b-9dac-f2f44bc73531 service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 1077.569105] env[65161]: INFO networking_nsxv3.common.synchronization [req-bdf497e9-4f37-4400-b973-c24eab5714cf req-c3dcec60-1a20-454b-9dac-f2f44bc73531 service nova] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 1077.569105] env[65161]: INFO networking_nsxv3.common.synchronization [req-bdf497e9-4f37-4400-b973-c24eab5714cf req-c3dcec60-1a20-454b-9dac-f2f44bc73531 service nova] Enqueued Resource ID: 8b8d0717-6834-44ee-b54e-4a189ddcd068 with Priority: HIGHEST for action port [ 1077.571453] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_rules [ 1077.571453] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 1077.571453] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b8d0717-6834-44ee-b54e-4a189ddcd068 with Priority: HIGHEST for action port [ 1077.571453] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.571453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.571453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.571453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.571453] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.572133] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.572231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.572430] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b8d0717-6834-44ee-b54e-4a189ddcd068 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.572529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b8d0717-6834-44ee-b54e-4a189ddcd068" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.572590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b8d0717-6834-44ee-b54e-4a189ddcd068" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.572747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b8d0717-6834-44ee-b54e-4a189ddcd068" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.572914] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b8d0717-6834-44ee-b54e-4a189ddcd068',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.075029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.075198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.075440] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b8d0717-6834-44ee-b54e-4a189ddcd068 with status ACTIVE [ 1078.075705] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.075835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.076205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.076205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.076205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.076366] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.076449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.076490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.076639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.076729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.076926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.077033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.077097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.077238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.077311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.077393] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b8d0717-6834-44ee-b54e-4a189ddcd068 is going to be updated. [ 1078.100704] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.100862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.100935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.101158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.101305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.101468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b8d0717-6834-44ee-b54e-4a189ddcd068" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.297642] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 1078.297943] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 1078.298145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.299032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.299369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.299628] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.299819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.299912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.300188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.300318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.300447] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.802988] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.305768] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.555179] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: SUCCESS [ 1079.555179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.555179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.555289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.555514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.555687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.555732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.555925] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.556052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.556183] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.808319] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.808615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.808615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.808757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.808845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.808941] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 1079.850434] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.850613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.850694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.850923] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.851771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.866627] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 1080.059536] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.561986] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.064826] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.065172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.065172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.065477] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.065611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.065751] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72c3d008-c3df-415c-97a1-58c326239709 is going to be updated. [ 1081.096873] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.097029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.097120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.097358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.097495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.106348] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: IN_PROGRESS for 2s [ 1081.877291] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 1081.877513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.877813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.877912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.878089] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.878333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.878333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.878567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.878663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.878663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.878806] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.381713] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.382074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.382074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.382319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.382573] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.382738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.382847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.383095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.383263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.383323] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.383669] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.383757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.383800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.383952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.384108] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.384286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.384347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.384502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.384609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.384660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.384751] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.571637] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1082.571637] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1082.887755] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 490d862d-f7b2-497d-912a-e1801d9b16ad: rpc.has_security_group_logging(os_id): False [ 1082.907602] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.907810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.907936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.909109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.909109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.909109] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.909109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.909109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.909109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.909442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.909442] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.909559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.909635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.909820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.909901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.910230] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.910320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.910374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.910536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.910614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.910764] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 1082.980582] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.980582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.980582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.980582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.980898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.994697] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 1083.116184] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: SUCCESS [ 1083.116646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.116958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.117219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.117416] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.117540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.117606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.117763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.117845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.118040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.118211] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.118294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.118357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.118504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.118657] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.118726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.118789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.118918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.118993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.119103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.119193] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.501975] env[65161]: INFO networking_nsxv3.common.synchronization [req-9bdfe005-d2f8-4066-a2e2-697ffd0ce237 req-6681d230-1d9a-4a83-92fb-f4075d044e7e tempest-ServerRescueTestJSON-311666717 tempest-ServerRescueTestJSON-311666717-project-member] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1083.502737] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1083.503177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.503354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.503449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.503711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.503911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.504075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.504164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.504444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.504582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.504741] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.621413] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72c3d008-c3df-415c-97a1-58c326239709: rpc.has_security_group_logging(os_id): False [ 1083.642726] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.642902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.642937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.643158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.643254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.643529] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.643529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.643609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.643731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.643808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.644046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.644107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.644207] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.644378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.644457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.644667] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.644790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.644854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.645050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.645137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.645255] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72c3d008-c3df-415c-97a1-58c326239709 is going to be created. [ 1083.713221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.713433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.713544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.713797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.713988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.725858] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: IN_PROGRESS for 2s [ 1084.008012] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.511187] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.013608] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.013813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.013892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.014363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.014543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.014689] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be updated. [ 1085.018653] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 1085.018653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.045294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.045488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.045564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.045779] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.045933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.056664] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: IN_PROGRESS for 2s [ 1085.743026] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: SUCCESS [ 1085.743026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.743026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.743026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.743026] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.247578] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.247767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.247847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.248168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.248360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.248461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.248600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.248798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.248902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.248991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.249122] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.674851] env[65161]: INFO networking_nsxv3.common.synchronization [req-ea5d08fe-6709-4b1f-ba2f-9d774da628b0 req-5c38030a-a412-40f4-afc3-2d8408cd26cd tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1086.674851] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1086.674851] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.674851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.674851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.675672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.676030] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.676360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.681056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.681056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.681056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.681056] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.752586] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.752914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.752914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.753048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.753217] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.754642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.754642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.754642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.754642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.754827] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.754923] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.755035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.755099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.755493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.755673] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.755776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.755842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.755992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.756092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.756176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.756268] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.040181] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.040390] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.040516] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.040795] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.041043] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.041205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.041323] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.041532] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.041676] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.041880] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.042026] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.042216] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.042348] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.042486] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.042609] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.042743] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.063031] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.063250] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.063421] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.063588] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.063891] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-2716f84a-5f76-4f55-95da-daf8b5d9abeb taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.064079] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-2716f84a-5f76-4f55-95da-daf8b5d9abeb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.064206] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-2716f84a-5f76-4f55-95da-daf8b5d9abeb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.065178] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-2716f84a-5f76-4f55-95da-daf8b5d9abeb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.065178] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2716f84a-5f76-4f55-95da-daf8b5d9abeb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.066276] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: SUCCESS [ 1087.066616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.180779] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.260569] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72c3d008-c3df-415c-97a1-58c326239709: rpc.has_security_group_logging(os_id): False [ 1087.282855] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.283029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.283432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.283866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.283984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.288253] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.288484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.288521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.288776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.288862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.289159] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.289308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.289363] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.289565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.289666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.289865] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.289967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.290048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.290194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.290270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.290373] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72c3d008-c3df-415c-97a1-58c326239709 is going to be updated. [ 1087.368983] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.369266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.369266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.369450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.369599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.387534] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: IN_PROGRESS for 2s [ 1087.568087] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.568330] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.568460] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.568767] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.568906] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.569077] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 2716f84a-5f76-4f55-95da-daf8b5d9abeb not found, creating... [ 1087.569390] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.569564] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.569683] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.569908] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.570063] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.570357] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.570519] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.570637] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.570850] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.570995] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.571418] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 2716f84a-5f76-4f55-95da-daf8b5d9abeb is going to be created. [ 1087.598795] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.599117] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.599250] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.599599] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.599887] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.600087] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-2716f84a-5f76-4f55-95da-daf8b5d9abeb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.683292] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.186606] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.187030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.187030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.187183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.187279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.187406] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1088.223885] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.224059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.224119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.224490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.224685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.236416] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1088.332466] env[65161]: INFO networking_nsxv3.common.synchronization [req-ea5d08fe-6709-4b1f-ba2f-9d774da628b0 req-0793c436-7e87-4132-9125-07bd73ea8836 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1088.332580] env[65161]: INFO networking_nsxv3.common.synchronization [req-ea5d08fe-6709-4b1f-ba2f-9d774da628b0 req-0793c436-7e87-4132-9125-07bd73ea8836 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1088.332718] env[65161]: INFO networking_nsxv3.common.synchronization [req-ea5d08fe-6709-4b1f-ba2f-9d774da628b0 req-0793c436-7e87-4132-9125-07bd73ea8836 service nova] Enqueued Resource ID: 2716f84a-5f76-4f55-95da-daf8b5d9abeb with Priority: HIGHEST for action port [ 1088.333293] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1088.333697] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1088.333697] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2716f84a-5f76-4f55-95da-daf8b5d9abeb with Priority: HIGHEST for action port [ 1088.333829] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.333928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.333991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.334223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.334344] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.335218] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.335321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.335510] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-2716f84a-5f76-4f55-95da-daf8b5d9abeb taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.335645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2716f84a-5f76-4f55-95da-daf8b5d9abeb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.335697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2716f84a-5f76-4f55-95da-daf8b5d9abeb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.335841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2716f84a-5f76-4f55-95da-daf8b5d9abeb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.335917] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2716f84a-5f76-4f55-95da-daf8b5d9abeb',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.838702] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.838979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.839135] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2716f84a-5f76-4f55-95da-daf8b5d9abeb with status ACTIVE [ 1088.839353] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.839648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.839648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.839872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.839945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.840177] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.840284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.840372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.840562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.840656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.841208] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.841208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.841208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.841447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.841490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.841629] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2716f84a-5f76-4f55-95da-daf8b5d9abeb is going to be updated. [ 1088.868233] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.868391] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.868391] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.868606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.868704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.868899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2716f84a-5f76-4f55-95da-daf8b5d9abeb" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.396279] env[65161]: INFO networking_nsxv3.common.synchronization [None req-3feca720-354d-49fd-8381-7f9c6e0b99df None None] Enqueued Resource ID: 8e1b59aa-9f41-4310-8a73-f6d4239aabaa with Priority: HIGHEST for action port [ 1089.398123] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1b59aa-9f41-4310-8a73-f6d4239aabaa with Priority: HIGHEST for action port [ 1089.398123] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e1b59aa-9f41-4310-8a73-f6d4239aabaa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.398123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e1b59aa-9f41-4310-8a73-f6d4239aabaa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.398123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e1b59aa-9f41-4310-8a73-f6d4239aabaa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.398123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e1b59aa-9f41-4310-8a73-f6d4239aabaa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.398123] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e1b59aa-9f41-4310-8a73-f6d4239aabaa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.409192] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: SUCCESS [ 1089.409636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.901028] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e1b59aa-9f41-4310-8a73-f6d4239aabaa [ 1089.901028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.901028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.901028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.901258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.901334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.901501] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e1b59aa-9f41-4310-8a73-f6d4239aabaa already deleted. [ 1089.901501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e1b59aa-9f41-4310-8a73-f6d4239aabaa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.248234] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1090.250561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.250561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.250561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.250561] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.250561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.250561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.250561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.250561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.250561] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.753918] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.258571] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.760890] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.761194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.761351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.761774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.761954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.762103] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1091.792957] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.793143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.793186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.793409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.793559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.804362] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1091.828560] env[65161]: INFO networking_nsxv3.common.synchronization [req-d8a08e85-62d8-4cb1-b876-307b5d3166ba req-e1cc4256-0a52-4d00-b906-21ec59670ca6 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1091.829128] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1091.830169] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.830169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.830169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.830169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.830474] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.830474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.830836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.830836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.830836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.831589] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.278650] env[65161]: INFO networking_nsxv3.common.synchronization [req-254b4ce6-d96d-4454-ba8b-83def0bf641b req-a6afd68f-7143-41e5-96e4-cbc90915290f tempest-ServerDiskConfigTestJSON-1077288781 tempest-ServerDiskConfigTestJSON-1077288781-project-member] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 1092.279694] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGHEST for action security_group_members [ 1092.279694] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.279694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.279694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.280987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.281225] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.281469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.281602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.281916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.282393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.282551] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.291283] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.291694] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.291859] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.292199] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.292694] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.292935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.293183] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.293598] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.293827] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.294207] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.294459] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.294666] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.294849] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.296557] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.297138] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.297138] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.320797] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.320797] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.320797] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.321049] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.321365] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-f7406f69-fd85-4693-a719-c4182f51ff54 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.321572] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-f7406f69-fd85-4693-a719-c4182f51ff54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.321705] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-f7406f69-fd85-4693-a719-c4182f51ff54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.322422] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-f7406f69-fd85-4693-a719-c4182f51ff54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.322422] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7406f69-fd85-4693-a719-c4182f51ff54',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.337136] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.337317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.337372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.337826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.337826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.337826] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.337956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.337994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.338224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.338224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.338322] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 already deleted. [ 1092.338377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.415662] env[65161]: INFO networking_nsxv3.common.synchronization [None req-4ac8a083-2225-48f3-bb6a-5ff486e53c1e None None] Enqueued Resource ID: 92accdfa-f209-40bc-813a-8eb684750ea0 with Priority: HIGHEST for action port [ 1092.417656] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92accdfa-f209-40bc-813a-8eb684750ea0 with Priority: HIGHEST for action port [ 1092.417656] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-92accdfa-f209-40bc-813a-8eb684750ea0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.417656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92accdfa-f209-40bc-813a-8eb684750ea0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.417656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92accdfa-f209-40bc-813a-8eb684750ea0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.417656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92accdfa-f209-40bc-813a-8eb684750ea0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.417958] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92accdfa-f209-40bc-813a-8eb684750ea0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.785465] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.785802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.785802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.785958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.786041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.786274] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.786433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.786542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.786748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.786832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.786918] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be updated. [ 1092.814871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.815121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.815228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.815482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.815623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.824916] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.824916] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.824916] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.824916] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.825126] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.825233] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port f7406f69-fd85-4693-a719-c4182f51ff54 not found, creating... [ 1092.825530] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.825693] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.825807] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.826037] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.826173] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.827151] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.827151] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.827151] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.827151] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.827151] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.828025] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: f7406f69-fd85-4693-a719-c4182f51ff54 is going to be created. [ 1092.829461] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: IN_PROGRESS for 2s [ 1092.849907] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.850143] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.850272] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.850568] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.850797] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.851039] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-f7406f69-fd85-4693-a719-c4182f51ff54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.922112] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92accdfa-f209-40bc-813a-8eb684750ea0 [ 1092.922361] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.922526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.922603] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.922832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.922926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.923037] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92accdfa-f209-40bc-813a-8eb684750ea0 already deleted. [ 1092.923125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92accdfa-f209-40bc-813a-8eb684750ea0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.619858] env[65161]: INFO networking_nsxv3.common.synchronization [req-d8a08e85-62d8-4cb1-b876-307b5d3166ba req-328041d3-5df4-47ac-baeb-4d112e76c549 service nova] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_rules [ 1093.619858] env[65161]: INFO networking_nsxv3.common.synchronization [req-d8a08e85-62d8-4cb1-b876-307b5d3166ba req-328041d3-5df4-47ac-baeb-4d112e76c549 service nova] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1093.619858] env[65161]: INFO networking_nsxv3.common.synchronization [req-d8a08e85-62d8-4cb1-b876-307b5d3166ba req-328041d3-5df4-47ac-baeb-4d112e76c549 service nova] Enqueued Resource ID: f7406f69-fd85-4693-a719-c4182f51ff54 with Priority: HIGHEST for action port [ 1093.619858] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_rules [ 1093.620298] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1093.620836] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7406f69-fd85-4693-a719-c4182f51ff54 with Priority: HIGHEST for action port [ 1093.621308] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.621552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.621598] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.621846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.621952] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.623630] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.623762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.623833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.625997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.625997] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.625997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.625997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.625997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.625997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.626249] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.627341] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7406f69-fd85-4693-a719-c4182f51ff54 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.627341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7406f69-fd85-4693-a719-c4182f51ff54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.627484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7406f69-fd85-4693-a719-c4182f51ff54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.627594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7406f69-fd85-4693-a719-c4182f51ff54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.627756] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7406f69-fd85-4693-a719-c4182f51ff54',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.823113] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1093.823113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.823113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.823113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.823113] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.823113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.823113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.823113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.823113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.823113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.823113] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.130145] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.130279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.130651] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.132677] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7406f69-fd85-4693-a719-c4182f51ff54 with status ACTIVE [ 1094.132677] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.132677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.132677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.132677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.132677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.134046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.134545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.134545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.134703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.134703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.136424] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.136424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.136424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.136424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.136424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.136424] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7406f69-fd85-4693-a719-c4182f51ff54 is going to be updated. [ 1094.168090] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.168090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.168090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.168090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.168090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.168090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7406f69-fd85-4693-a719-c4182f51ff54" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.202720] env[65161]: INFO networking_nsxv3.common.synchronization [None req-fc7814b1-8b2c-4a75-8667-5093a1be8258 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_rules [ 1094.203287] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_rules [ 1094.203881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e2ddd89-773b-40cd-95c8-c99371221138 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.204018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.204113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.204534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.204534] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.308621] env[65161]: INFO networking_nsxv3.common.synchronization [None req-3e086b30-c385-48a7-834e-1168956c0206 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_rules [ 1094.308621] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_rules [ 1094.309059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e2ddd89-773b-40cd-95c8-c99371221138 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.309172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.325790] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.325952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.326037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.326273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.326440] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.326547] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.326612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.326833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.326875] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.326954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.327120] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.327214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.327274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.327412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.327562] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.327652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.327762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.327860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.327938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.329457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.329651] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.638369] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.725810] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.726944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.726944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.726944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.726944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.726944] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e2ddd89-773b-40cd-95c8-c99371221138 already deleted. [ 1094.726944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.726944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.726944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.727430] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.833393] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caaaa94-1988-4a64-baf8-2e9ad4c3a553: rpc.has_security_group_logging(os_id): False [ 1094.844385] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 490d862d-f7b2-497d-912a-e1801d9b16ad in Status: SUCCESS [ 1094.844596] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad deletion is rescheduled due to dependency. [ 1094.844717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.853382] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.853540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.853540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.853732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.853815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.853998] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.854121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.854194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.854338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.854447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.854639] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.854740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.854813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.854954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.855048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.855218] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.855310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.855374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.855529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.855637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.855718] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1094.938433] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.938721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.938803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.939024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.939211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.955258] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1095.141356] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.141569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.142369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.142369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.142369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.142369] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 is going to be created. [ 1095.173104] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.173387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.173445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.173720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.173931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.185054] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: UNINITIALIZED for 2s [ 1095.269896] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.269896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.269896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.269896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.269896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.269896] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e2ddd89-773b-40cd-95c8-c99371221138 already deleted. [ 1095.269896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.274593] env[65161]: INFO networking_nsxv3.common.synchronization [req-4309719e-d8f7-452f-8f7a-13b2aededb5a req-b8f86033-e8f3-48d8-b202-b5bbbcad1fb3 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1096.275124] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1096.275576] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.275747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.275859] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.276476] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.276476] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.276609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.276657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.276867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.276967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.277165] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.632387] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.632686] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.632939] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.633081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.633344] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.633501] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.633662] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.633826] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.634022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.634199] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.634299] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.634436] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.634582] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.634705] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.634803] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.634935] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.655017] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.655205] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.655331] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.655611] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.655910] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-2ff378da-a06b-4771-8f76-041b28f7d357 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.656103] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-2ff378da-a06b-4771-8f76-041b28f7d357" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.656227] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-2ff378da-a06b-4771-8f76-041b28f7d357" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.656549] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-2ff378da-a06b-4771-8f76-041b28f7d357" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.656694] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff378da-a06b-4771-8f76-041b28f7d357',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.781501] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.781678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.781734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.782065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.782163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.782390] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.782522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.782560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.782716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.782794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.782882] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1096.809571] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.809726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.809769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.810025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.810128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.819619] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1096.985339] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1096.985543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.159262] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.159529] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.159655] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.160182] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.160361] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.160528] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 2ff378da-a06b-4771-8f76-041b28f7d357 not found, creating... [ 1097.160831] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.160997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.161144] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.161377] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.161518] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.161824] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.162010] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.162134] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.162360] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.162574] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.162718] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 2ff378da-a06b-4771-8f76-041b28f7d357 is going to be created. [ 1097.187979] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.188291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.188480] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.188802] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.189088] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.189398] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-2ff378da-a06b-4771-8f76-041b28f7d357" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.201024] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: SUCCESS [ 1097.201348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.201568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.201823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.202163] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.202309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.202608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.202608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.202751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.202751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.203512] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.708436] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.936500] env[65161]: INFO networking_nsxv3.common.synchronization [req-4309719e-d8f7-452f-8f7a-13b2aededb5a req-7f893649-e940-4534-a271-b2fc7a99d1ec service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1097.936696] env[65161]: INFO networking_nsxv3.common.synchronization [req-4309719e-d8f7-452f-8f7a-13b2aededb5a req-7f893649-e940-4534-a271-b2fc7a99d1ec service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1097.936846] env[65161]: INFO networking_nsxv3.common.synchronization [req-4309719e-d8f7-452f-8f7a-13b2aededb5a req-7f893649-e940-4534-a271-b2fc7a99d1ec service nova] Enqueued Resource ID: 2ff378da-a06b-4771-8f76-041b28f7d357 with Priority: HIGHEST for action port [ 1097.938100] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1097.938100] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1097.938100] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff378da-a06b-4771-8f76-041b28f7d357 with Priority: HIGHEST for action port [ 1097.938100] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.938422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.938422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.938422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.938575] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.940095] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.940226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.940495] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ff378da-a06b-4771-8f76-041b28f7d357 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.940630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ff378da-a06b-4771-8f76-041b28f7d357" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.940726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ff378da-a06b-4771-8f76-041b28f7d357" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.940933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ff378da-a06b-4771-8f76-041b28f7d357" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.941061] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff378da-a06b-4771-8f76-041b28f7d357',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.210441] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377: rpc.has_security_group_logging(os_id): False [ 1098.231865] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.232137] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.232339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.232613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.232728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.233058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.233744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.233829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.235377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.235481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.235624] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 is going to be created. [ 1098.316259] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.316259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.316259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.316259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.316259] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.330092] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: IN_PROGRESS for 2s [ 1098.441106] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.441348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.443870] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ff378da-a06b-4771-8f76-041b28f7d357 with status ACTIVE [ 1098.444220] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.444418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.444538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.444846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.444993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.445280] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.445465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.445683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.446078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.446078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.446201] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.446346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.446609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.446665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.446790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.446921] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ff378da-a06b-4771-8f76-041b28f7d357 is going to be updated. [ 1098.475700] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.476600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.476801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.477181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.477440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.477743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ff378da-a06b-4771-8f76-041b28f7d357" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.832104] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1098.832104] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1098.832104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.832104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.832104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.832694] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.832694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.832694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.832694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.832694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.832694] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.334719] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.837966] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.851154] env[65161]: INFO networking_nsxv3.common.synchronization [req-e140b8ac-c1ac-4bc5-aef9-7662dd47370a req-79b46024-cf29-4151-adc3-34d4897306bd tempest-ServersNegativeTestJSON-2079955183 tempest-ServersNegativeTestJSON-2079955183-project-member] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 1099.852191] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGHEST for action security_group_members [ 1099.852621] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.852786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.852986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.853545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.853545] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.853545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.853715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.854018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.854018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.854179] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.340752] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.340912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.341010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.341258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.341370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.341583] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1100.345787] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: SUCCESS [ 1100.345960] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.359758] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.359981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.360059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.360368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.360483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.360715] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.360937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.361031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.361272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.361383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.361467] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be updated. [ 1100.393456] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.394834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.394834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.395105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.395105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.424724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.424917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.424963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.425214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.425427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.427783] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1100.435067] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: IN_PROGRESS for 2s [ 1100.662845] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ef65694-8465-4cf6-946a-696fdfdb1484 req-ba275018-2cb9-47e1-a505-0a5dfddda8c8 tempest-InstanceActionsTestJSON-103265088 tempest-InstanceActionsTestJSON-103265088-project-member] Enqueued Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGHEST for action security_group_members [ 1100.663464] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGHEST for action security_group_members [ 1100.663803] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5866be-f91a-4727-a28f-3e308ac779d0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.663923] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.663986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.664440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.664566] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.665308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.665308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.665308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.665308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.665308] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.019802] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-282 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.020099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-282" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.020141] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-282" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.020492] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-282" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.020751] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.021179] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.021179] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.021332] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.021381] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.021574] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.021700] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.021808] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.021915] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.022030] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.022139] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.022265] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.044107] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.044304] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.044427] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.044689] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-282" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.045180] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-26d790ac-f940-4c71-9b38-7b336af973fa taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.045293] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-26d790ac-f940-4c71-9b38-7b336af973fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.045330] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-26d790ac-f940-4c71-9b38-7b336af973fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.045673] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-26d790ac-f940-4c71-9b38-7b336af973fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.045837] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d790ac-f940-4c71-9b38-7b336af973fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.168518] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.168518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.168518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.168518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.168518] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.168841] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.168917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.168959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.169146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.170276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.170276] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 already deleted. [ 1101.170276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.548162] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.548476] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.548679] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.549039] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.549208] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.549378] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 26d790ac-f940-4c71-9b38-7b336af973fa not found, creating... [ 1101.549686] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.549892] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.550059] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.550344] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.550516] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.550845] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.551038] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.551164] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.551369] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.551503] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.551643] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 26d790ac-f940-4c71-9b38-7b336af973fa is going to be created. [ 1101.586516] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.586861] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.587437] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.587607] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.587827] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.588191] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-26d790ac-f940-4c71-9b38-7b336af973fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.029145] env[65161]: INFO networking_nsxv3.common.synchronization [req-5ed6fc60-b956-4074-9501-cbdc75e5f1ed req-4e1a0b63-1796-4d45-a9d9-c3575ffcda32 tempest-ServerRescueTestJSON-311666717 tempest-ServerRescueTestJSON-311666717-project-member] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1102.029779] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGHEST for action security_group_members [ 1102.030206] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.030337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.030399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.030588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.030731] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.031309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.031309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.031309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.031309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.031309] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.325377] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ef65694-8465-4cf6-946a-696fdfdb1484 req-19832d9f-9e18-444b-bbc5-7a1a336dc7ff service nova] Enqueued Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGHEST for action security_group_rules [ 1102.325917] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ef65694-8465-4cf6-946a-696fdfdb1484 req-19832d9f-9e18-444b-bbc5-7a1a336dc7ff service nova] Enqueued Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGHEST for action security_group_members [ 1102.325917] env[65161]: INFO networking_nsxv3.common.synchronization [req-0ef65694-8465-4cf6-946a-696fdfdb1484 req-19832d9f-9e18-444b-bbc5-7a1a336dc7ff service nova] Enqueued Resource ID: 26d790ac-f940-4c71-9b38-7b336af973fa with Priority: HIGHEST for action port [ 1102.326226] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGHEST for action security_group_rules [ 1102.326355] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGHEST for action security_group_members [ 1102.326446] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d790ac-f940-4c71-9b38-7b336af973fa with Priority: HIGHEST for action port [ 1102.327178] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5866be-f91a-4727-a28f-3e308ac779d0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.327318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.327384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.329211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.329211] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.329211] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5866be-f91a-4727-a28f-3e308ac779d0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.329211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.329211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.329211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.329211] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.330139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.330139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.330139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.330139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.330139] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.330664] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d790ac-f940-4c71-9b38-7b336af973fa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.330664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d790ac-f940-4c71-9b38-7b336af973fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.330664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d790ac-f940-4c71-9b38-7b336af973fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.330664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d790ac-f940-4c71-9b38-7b336af973fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.330843] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d790ac-f940-4c71-9b38-7b336af973fa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.438288] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1102.438584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.438833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.439167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.439426] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.439612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.439718] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.439967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.440146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.440301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.440473] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.449668] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3e3e485-b210-4594-a46e-85922cc804cf in Status: SUCCESS [ 1102.449782] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3e3e485-b210-4594-a46e-85922cc804cf deletion is rescheduled due to dependency. [ 1102.449872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.533223] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.533377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.533450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.533668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.533765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.533966] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.534086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.534149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.534328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.534404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.534492] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be updated. [ 1102.562763] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.562763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.562763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.562964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.563122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.574495] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: IN_PROGRESS for 2s [ 1102.833626] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.835036] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5866be-f91a-4727-a28f-3e308ac779d0 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.835120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.835518] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26d790ac-f940-4c71-9b38-7b336af973fa with status ACTIVE [ 1102.835713] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.835907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.835907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.836173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.836272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.836448] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.836544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.836591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.836794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.836869] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.837034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.837146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.837203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.837711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.837711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.837711] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26d790ac-f940-4c71-9b38-7b336af973fa is going to be updated. [ 1102.863417] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.863648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.863728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.863986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.864177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.864381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d790ac-f940-4c71-9b38-7b336af973fa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.943575] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.943834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.943891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.944117] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.944291] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.944393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.944497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.944711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.944808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.944899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.945078] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.945183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.945234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.945434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.945590] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.945717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.945787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.945947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.946040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.946143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.946256] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.338134] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.448707] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ad3588-f61e-418d-9a8e-c65add44c1be: rpc.has_security_group_logging(os_id): False [ 1103.469422] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.469422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.469422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.469422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.469422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.469422] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.469422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.469422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.470504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.470504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.470504] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.470504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.470504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.470504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.470504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.470504] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.470504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.470504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.470882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.470882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.470882] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1103.545885] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.546047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.546106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.546347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.546498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.572452] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1103.840557] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.840870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.840870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.841058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.841158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.841258] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 is going to be created. [ 1103.868877] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.869373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.869373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.869373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.870140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.882337] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 in Status: UNINITIALIZED for 2s [ 1104.584298] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa in Status: SUCCESS [ 1104.584640] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa deletion is rescheduled due to dependency. [ 1104.584640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.589111] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1105.590121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.894849] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 in Status: SUCCESS [ 1105.894849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.894849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.894849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.894849] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.894849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.894849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.894849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.894849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.894849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.894849] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.397684] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5866be-f91a-4727-a28f-3e308ac779d0 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.397972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.398146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.398413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.399299] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.399299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.399299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.399299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.399299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.399579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.399579] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5866be-f91a-4727-a28f-3e308ac779d0 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.399719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.399949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.399949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.400184] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.400471] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.400471] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.400609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.400609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.400696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.400814] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.903587] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f5866be-f91a-4727-a28f-3e308ac779d0: rpc.has_security_group_logging(os_id): False [ 1106.926121] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.926305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.926343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.926571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.926663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.926949] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.927140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.927462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.927710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.927921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.928163] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.928267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.928331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.928483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.928570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.928844] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.928971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.929088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.929257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.929353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.929497] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 is going to be created. [ 1107.007699] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.007868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.007868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.008445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.008445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.024015] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 in Status: IN_PROGRESS for 2s [ 1107.330021] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1107.330021] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1108.576038] env[65161]: INFO networking_nsxv3.common.synchronization [req-59f9fa95-3ca0-43ca-aa75-c3ebe6c4de18 req-bec70acf-1cb8-4f87-a9d7-301504c4c887 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_members [ 1108.576617] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_members [ 1108.577024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e2ddd89-773b-40cd-95c8-c99371221138 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.577733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.577836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.578144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.578348] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.578549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.578657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.578878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.578976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.579143] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.781098] env[65161]: INFO networking_nsxv3.common.synchronization [req-7c7d0080-da1b-4872-a14a-42a3e8997f64 req-a66a372e-6028-4551-8ba9-244669d84fab tempest-AttachVolumeTestJSON-1674268260 tempest-AttachVolumeTestJSON-1674268260-project-member] Enqueued Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_members [ 1108.781639] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGHEST for action security_group_members [ 1108.782047] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.782167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.782167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.782350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.782996] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.782996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.782996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.782996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.783278] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.783278] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.037739] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 in Status: SUCCESS [ 1109.038113] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.083173] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.083328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.083414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.083651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.083781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.084106] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.084106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.084235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.084281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.084353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.084434] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e2ddd89-773b-40cd-95c8-c99371221138 already deleted. [ 1109.084656] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.089041] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.089041] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.089041] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.089329] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.089573] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.089751] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.089872] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.090149] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.090314] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.090528] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.090662] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.091547] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.091701] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.093051] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.093051] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.093519] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.116901] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.117140] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.117504] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.117504] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.117801] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-824320f5-32ff-464f-abce-a05c7122b9b8 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.117985] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-824320f5-32ff-464f-abce-a05c7122b9b8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.118120] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-824320f5-32ff-464f-abce-a05c7122b9b8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.118452] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-824320f5-32ff-464f-abce-a05c7122b9b8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.118593] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('824320f5-32ff-464f-abce-a05c7122b9b8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.286188] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.286546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.286546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.286680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.286761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.287552] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.287552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.287552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.287552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.287552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.287826] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 is going to be updated. [ 1109.318493] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.318771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.318771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.319095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.319280] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.328326] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64d87f90-5895-4771-acb4-8aaeff02c417 in Status: IN_PROGRESS for 2s [ 1109.621011] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.621366] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.621445] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.621677] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.622061] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.622154] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 824320f5-32ff-464f-abce-a05c7122b9b8 not found, creating... [ 1109.622374] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.622576] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.622674] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.622903] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.623054] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.623348] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.623763] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.624918] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.625391] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.625391] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.625525] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 824320f5-32ff-464f-abce-a05c7122b9b8 is going to be created. [ 1109.647525] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.647735] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.647783] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.648847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.648847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.648847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-824320f5-32ff-464f-abce-a05c7122b9b8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.452835] env[65161]: INFO networking_nsxv3.common.synchronization [req-59f9fa95-3ca0-43ca-aa75-c3ebe6c4de18 req-2faac151-c83d-4aa2-8fb9-5831e20c42f8 service nova] Enqueued Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_rules [ 1110.454108] env[65161]: INFO networking_nsxv3.common.synchronization [req-59f9fa95-3ca0-43ca-aa75-c3ebe6c4de18 req-2faac151-c83d-4aa2-8fb9-5831e20c42f8 service nova] Enqueued Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_members [ 1110.454108] env[65161]: INFO networking_nsxv3.common.synchronization [req-59f9fa95-3ca0-43ca-aa75-c3ebe6c4de18 req-2faac151-c83d-4aa2-8fb9-5831e20c42f8 service nova] Enqueued Resource ID: 824320f5-32ff-464f-abce-a05c7122b9b8 with Priority: HIGHEST for action port [ 1110.454108] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_rules [ 1110.454108] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_members [ 1110.454108] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 824320f5-32ff-464f-abce-a05c7122b9b8 with Priority: HIGHEST for action port [ 1110.454831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e2ddd89-773b-40cd-95c8-c99371221138 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.454970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.455045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.455312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.455378] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.456312] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e2ddd89-773b-40cd-95c8-c99371221138 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.456538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.456538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.456650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.456818] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.456912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.456977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.457134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.457236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.457556] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.458173] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-824320f5-32ff-464f-abce-a05c7122b9b8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.458305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-824320f5-32ff-464f-abce-a05c7122b9b8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.458468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-824320f5-32ff-464f-abce-a05c7122b9b8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.458509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-824320f5-32ff-464f-abce-a05c7122b9b8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.458553] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('824320f5-32ff-464f-abce-a05c7122b9b8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.960031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e2ddd89-773b-40cd-95c8-c99371221138 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.960352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.960434] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.961536] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 824320f5-32ff-464f-abce-a05c7122b9b8 with status ACTIVE [ 1110.961584] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.961704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.961802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.962064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.962159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.962381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.963125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.963125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.963125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.963125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.963125] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.963125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.963125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.963455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.963455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.963455] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 824320f5-32ff-464f-abce-a05c7122b9b8 is going to be updated. [ 1110.987307] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.987307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.987307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.987565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.987565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.987693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-824320f5-32ff-464f-abce-a05c7122b9b8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.072904] env[65161]: INFO networking_nsxv3.common.synchronization [req-7758dc3f-bb1f-4ef5-aa3c-5f6f9ce02af8 req-16f2e5f9-f1c9-4e2e-8df2-5a54c0c4bd62 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1111.073508] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1111.073854] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.073994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.074089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.074298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.074455] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.074551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.074614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.074759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.074843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.074933] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.338993] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64d87f90-5895-4771-acb4-8aaeff02c417 in Status: SUCCESS [ 1111.338993] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 deletion is rescheduled due to dependency. [ 1111.339186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.447789] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.447997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.448147] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.448438] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.448761] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.448878] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.448992] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.449237] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.449387] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.449641] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.449736] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.449821] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.449933] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.450072] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.450185] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.450321] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.468128] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.470241] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.470413] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.470541] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.470713] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.471211] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-0e8c7258-38d7-4cc3-9faf-377fbf801486 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.471303] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-0e8c7258-38d7-4cc3-9faf-377fbf801486" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.471459] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-0e8c7258-38d7-4cc3-9faf-377fbf801486" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.471750] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-0e8c7258-38d7-4cc3-9faf-377fbf801486" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.472155] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8c7258-38d7-4cc3-9faf-377fbf801486',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.578660] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.970407] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.970716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.970716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.970823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.970876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.970970] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e2ddd89-773b-40cd-95c8-c99371221138 is going to be created. [ 1111.973968] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.974196] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.974350] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.974559] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.974773] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.974943] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 0e8c7258-38d7-4cc3-9faf-377fbf801486 not found, creating... [ 1111.975220] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.975380] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.975497] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.975710] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.975877] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.976173] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.976330] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.976446] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.976651] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.976788] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.976927] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 0e8c7258-38d7-4cc3-9faf-377fbf801486 is going to be created. [ 1112.001587] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.001734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.001796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.001997] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.002175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.004105] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.004294] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.004419] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.004651] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.004914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.005143] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-0e8c7258-38d7-4cc3-9faf-377fbf801486" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.015343] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e2ddd89-773b-40cd-95c8-c99371221138 in Status: UNINITIALIZED for 2s [ 1112.081493] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.585239] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.585408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.585525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.585702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.585832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.585939] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1112.620127] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.620333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.620402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.620613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.620813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.631312] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1112.739754] env[65161]: INFO networking_nsxv3.common.synchronization [req-7758dc3f-bb1f-4ef5-aa3c-5f6f9ce02af8 req-8a5f6acd-74c3-42f1-bc5f-83621277ada2 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1112.740572] env[65161]: INFO networking_nsxv3.common.synchronization [req-7758dc3f-bb1f-4ef5-aa3c-5f6f9ce02af8 req-8a5f6acd-74c3-42f1-bc5f-83621277ada2 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1112.740572] env[65161]: INFO networking_nsxv3.common.synchronization [req-7758dc3f-bb1f-4ef5-aa3c-5f6f9ce02af8 req-8a5f6acd-74c3-42f1-bc5f-83621277ada2 service nova] Enqueued Resource ID: 0e8c7258-38d7-4cc3-9faf-377fbf801486 with Priority: HIGHEST for action port [ 1112.741168] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1112.741168] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1112.741309] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e8c7258-38d7-4cc3-9faf-377fbf801486 with Priority: HIGHEST for action port [ 1112.741719] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.741795] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.741902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.743150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.743150] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.744584] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.744684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.745165] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e8c7258-38d7-4cc3-9faf-377fbf801486 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.745165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e8c7258-38d7-4cc3-9faf-377fbf801486" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.745165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e8c7258-38d7-4cc3-9faf-377fbf801486" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.746837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e8c7258-38d7-4cc3-9faf-377fbf801486" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.746837] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8c7258-38d7-4cc3-9faf-377fbf801486',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.245410] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.245786] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.248986] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e8c7258-38d7-4cc3-9faf-377fbf801486 with status ACTIVE [ 1113.249253] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.249426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.249504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.249728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.249826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.250022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.250128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.250194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.250381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.250420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.250594] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.250690] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.250754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.250967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.251024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.251119] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e8c7258-38d7-4cc3-9faf-377fbf801486 is going to be updated. [ 1113.271837] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.272032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.272077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.272269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.272408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.272567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e8c7258-38d7-4cc3-9faf-377fbf801486" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.026672] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e2ddd89-773b-40cd-95c8-c99371221138 in Status: SUCCESS [ 1114.026913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.027129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.027359] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.027555] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.027673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.027735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.028044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.028044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.028101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.028753] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.535233] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.646368] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1114.646608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.646722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.648275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.648275] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.648275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.648275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.648275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.648275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.648275] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.037291] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e2ddd89-773b-40cd-95c8-c99371221138: rpc.has_security_group_logging(os_id): False [ 1115.058178] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.058271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.058307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.058561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.058654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.058916] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.059031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.059096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.059257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.059334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.059421] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e2ddd89-773b-40cd-95c8-c99371221138 is going to be created. [ 1115.119403] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.119565] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.119639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.119880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.120086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.137631] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e2ddd89-773b-40cd-95c8-c99371221138 in Status: IN_PROGRESS for 2s [ 1115.152163] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.657446] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.162120] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.162120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.162120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.162322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.162352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.162516] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1116.195791] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.196044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.196044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.197095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.197095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.206743] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1117.156418] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e2ddd89-773b-40cd-95c8-c99371221138 in Status: SUCCESS [ 1117.157748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.742570] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1117.742570] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1118.218296] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 4s [ 1118.445320] env[65161]: INFO networking_nsxv3.common.synchronization [req-636631ed-7aed-4df6-a89b-5a9b417b8506 req-3ee62a8e-b219-4d81-9308-6bb2c2817d4f tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1118.445839] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1118.446196] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.446373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.446421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.446724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.446804] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.446892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.446951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.447129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.447293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.447352] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.797257] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.797458] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.797582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.797863] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.798166] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.798326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.798442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.798654] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.798823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.799058] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.799174] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.799281] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.799387] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.799494] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.799600] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.799727] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.821199] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.821450] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.821629] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.821841] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.822240] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-4320c90c-abd6-4525-b3da-d9dd85e84c89 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.822521] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-4320c90c-abd6-4525-b3da-d9dd85e84c89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.822622] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-4320c90c-abd6-4525-b3da-d9dd85e84c89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.823023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-4320c90c-abd6-4525-b3da-d9dd85e84c89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.823166] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4320c90c-abd6-4525-b3da-d9dd85e84c89',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.950570] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.325678] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.326110] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.326178] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.326464] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.326617] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.326776] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 4320c90c-abd6-4525-b3da-d9dd85e84c89 not found, creating... [ 1119.327187] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.327344] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.327442] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.327685] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.327838] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.328193] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.328354] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.328566] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.328818] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.329059] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.329230] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 4320c90c-abd6-4525-b3da-d9dd85e84c89 is going to be created. [ 1119.354136] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.354390] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.354607] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.355068] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.355331] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.355628] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-4320c90c-abd6-4525-b3da-d9dd85e84c89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.453705] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.957373] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.957373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.957373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.957601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.957601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.957664] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 is going to be updated. [ 1119.991420] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.991587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.991636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.991831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.991979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.002514] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: IN_PROGRESS for 2s [ 1120.104866] env[65161]: INFO networking_nsxv3.common.synchronization [req-636631ed-7aed-4df6-a89b-5a9b417b8506 req-7911b7b4-e2ad-434d-ab67-c72cbaf58666 service nova] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_rules [ 1120.105167] env[65161]: INFO networking_nsxv3.common.synchronization [req-636631ed-7aed-4df6-a89b-5a9b417b8506 req-7911b7b4-e2ad-434d-ab67-c72cbaf58666 service nova] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1120.105328] env[65161]: INFO networking_nsxv3.common.synchronization [req-636631ed-7aed-4df6-a89b-5a9b417b8506 req-7911b7b4-e2ad-434d-ab67-c72cbaf58666 service nova] Enqueued Resource ID: 4320c90c-abd6-4525-b3da-d9dd85e84c89 with Priority: HIGHEST for action port [ 1120.106944] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_rules [ 1120.106944] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1120.106944] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4320c90c-abd6-4525-b3da-d9dd85e84c89 with Priority: HIGHEST for action port [ 1120.106944] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.106944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.107310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.107569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.107807] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.109241] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.109382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.109613] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-4320c90c-abd6-4525-b3da-d9dd85e84c89 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.109747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4320c90c-abd6-4525-b3da-d9dd85e84c89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.109857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4320c90c-abd6-4525-b3da-d9dd85e84c89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.110111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4320c90c-abd6-4525-b3da-d9dd85e84c89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.110215] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4320c90c-abd6-4525-b3da-d9dd85e84c89',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.230144] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1120.230587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.230863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.231109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.231408] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.231554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.231617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.231774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.231858] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.231947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.232073] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.543858] env[65161]: INFO networking_nsxv3.common.synchronization [req-10ec9c3d-35e1-4621-b2ce-a6b82c4b4f32 req-72e306d5-37f0-45ad-b7dd-a631c3c898dd tempest-InstanceActionsTestJSON-103265088 tempest-InstanceActionsTestJSON-103265088-project-member] Enqueued Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGHEST for action security_group_members [ 1120.544410] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGHEST for action security_group_members [ 1120.544726] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5866be-f91a-4727-a28f-3e308ac779d0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.544905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.545065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.545201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.545364] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.545503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.545503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.545624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.545725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.545841] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.612384] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.612560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.615974] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4320c90c-abd6-4525-b3da-d9dd85e84c89 with status ACTIVE [ 1120.616231] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.616412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.616532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.616648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.616738] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.616910] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.617083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.617083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.617296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.617296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.617488] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.617612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.617612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.617811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.617811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.618025] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4320c90c-abd6-4525-b3da-d9dd85e84c89 is going to be updated. [ 1120.647024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.647024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.647024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.647024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.647207] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.647243] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4320c90c-abd6-4525-b3da-d9dd85e84c89" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.736567] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.736567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.736567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.736567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.736567] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.737177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.737177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.737177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.737177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.737177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.737308] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.737507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.737507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.737647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.737778] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.737879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.738135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.738135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.738135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.738304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.738343] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.809229] env[65161]: INFO networking_nsxv3.common.synchronization [req-07b2465e-f256-497d-a318-6e747fa107bf req-dbc94bcd-b003-4aa2-87e8-d9d5aff70ade tempest-ServersV294TestFqdnHostnames-2030996159 tempest-ServersV294TestFqdnHostnames-2030996159-project-member] Enqueued Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_members [ 1120.810041] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGHEST for action security_group_members [ 1120.810425] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.810763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.810763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.810959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.810959] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.811116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.811165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.811507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.811507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.811636] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.049073] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.049073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.049073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.049073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.049073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.049417] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.049417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.049498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.049661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.049788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.049845] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 is going to be updated. [ 1121.080388] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.080388] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.080388] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.080586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.080689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.090678] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 in Status: IN_PROGRESS for 2s [ 1121.240976] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caaaa94-1988-4a64-baf8-2e9ad4c3a553: rpc.has_security_group_logging(os_id): False [ 1121.264658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.264658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.264658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.264658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.264658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.264658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.264658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.264658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.265176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.265176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.265176] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.265284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.265318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.265494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.265579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.265726] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.265836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.265895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.266106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.266196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.266295] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1121.314645] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.314818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.314969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.315215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.315306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.315499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.315601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.315694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.315871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.315982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.316376] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 is going to be updated. [ 1121.346781] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.346781] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.347026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.347724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.347724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.363087] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 in Status: IN_PROGRESS for 2s [ 1121.364191] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.364314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.366019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.366019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.366019] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.386935] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1122.012131] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: SUCCESS [ 1122.012462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.012512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.012747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.012959] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.013104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.013173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.013337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.013419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.013519] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.516067] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.020854] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.104448] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 in Status: SUCCESS [ 1123.104607] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 deletion is rescheduled due to dependency. [ 1123.104711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.372752] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 in Status: SUCCESS [ 1123.372952] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 deletion is rescheduled due to dependency. [ 1123.373063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.407070] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1123.407290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.523368] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.523575] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.523618] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.523910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.524055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.524189] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 is going to be updated. [ 1123.553995] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.554202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.554282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.554485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.554632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.564015] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: IN_PROGRESS for 2s [ 1124.811256] env[65161]: INFO networking_nsxv3.common.synchronization [req-5de0d19d-a247-41fb-8aa7-d3f974ce40b3 req-4625c8ba-79da-4a8d-9f27-5cbe1a120dcb tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1124.812067] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1124.812532] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.812726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.812840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.813143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.813410] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.813521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.813627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.813868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.814032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.814197] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.317272] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.574232] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: SUCCESS [ 1125.574527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.574648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.574976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.575200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.575328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.575397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.575557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.575640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.575729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.575821] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.819878] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.078547] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.322460] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.323463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.323463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.323463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.323463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.323815] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1126.354474] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.354647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.354724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.355184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.355439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.367046] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1126.581502] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377: rpc.has_security_group_logging(os_id): False [ 1126.604237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.604414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.604489] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.604783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.604902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.605253] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.605376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.605451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.605611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.605693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.605809] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 is going to be updated. [ 1126.713336] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.713537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.713629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.713881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.714073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.748275] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: IN_PROGRESS for 2s [ 1128.377148] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1128.377537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.768788] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: SUCCESS [ 1128.769029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.448065] env[65161]: INFO networking_nsxv3.common.synchronization [None req-4b65c828-670d-47be-9da4-ed066c1f863f tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1129.448637] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1129.448804] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.448998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.448998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.449290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.449452] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.449668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.449668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.449880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.451349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.451349] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.954721] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.954721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.954721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.956025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.956025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.956025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.956025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.956025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.956025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.956025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.956025] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda already deleted. [ 1129.956025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.386417] env[65161]: INFO networking_nsxv3.common.synchronization [req-e95a990c-526a-408d-87f7-a5b8a96fc534 req-d3fced58-ea23-4efe-97e6-c60f93fd6c30 tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1130.386732] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1130.387557] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.387754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.387754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.387993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.388253] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.388396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.388498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.388730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.388886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.389064] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.894048] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.894453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.894453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.894453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.938046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.938046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.938046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.938046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.938396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.938396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.938562] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1130.969227] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.969431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.969431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.969909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.969909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.979694] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1132.992915] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1132.993253] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 deletion is rescheduled due to dependency. [ 1132.993298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.388757] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1135.388757] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1135.738027] env[65161]: INFO networking_nsxv3.common.synchronization [None req-ef148308-9603-412a-b2a2-d90dafe22b88 None None] Enqueued Resource ID: a25dd17d-335f-40d0-b650-6729071f4a67 with Priority: HIGHEST for action port [ 1135.739036] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25dd17d-335f-40d0-b650-6729071f4a67 with Priority: HIGHEST for action port [ 1135.739565] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a25dd17d-335f-40d0-b650-6729071f4a67 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.739833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a25dd17d-335f-40d0-b650-6729071f4a67" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.739909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a25dd17d-335f-40d0-b650-6729071f4a67" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.740270] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a25dd17d-335f-40d0-b650-6729071f4a67" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.740431] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a25dd17d-335f-40d0-b650-6729071f4a67',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.229259] env[65161]: INFO networking_nsxv3.common.synchronization [req-b50c6d6f-5c28-4c84-9140-9e3540073d13 req-2d545a26-1a5a-4343-a8c0-4c7fc5954bcd tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1136.230073] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1136.230520] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.230771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.230934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.231228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.231477] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.231711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.231877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.233429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.233429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.233429] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.245792] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a25dd17d-335f-40d0-b650-6729071f4a67 [ 1136.245792] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.245792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.245792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.245792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.245792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.245792] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a25dd17d-335f-40d0-b650-6729071f4a67 already deleted. [ 1136.245792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a25dd17d-335f-40d0-b650-6729071f4a67" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.735331] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.238592] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.741808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.742711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.742711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.742711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.742711] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.742711] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1137.779397] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.779613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.779655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.780056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.780056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.791276] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1137.842816] env[65161]: INFO networking_nsxv3.common.synchronization [req-f966bbf0-df58-4220-a770-ab593fa5c06a req-01030809-9113-465d-b29d-376a4c233791 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1137.843098] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1137.843771] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.844090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.846075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.846075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.846075] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.846075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.846075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.846075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.846075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.846075] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.323803] env[65161]: INFO networking_nsxv3.common.synchronization [None req-3ae2a54b-5bd5-4101-892f-2e7b7edadef2 None None] Enqueued Resource ID: 7a1bc13c-6f6b-4407-bdaa-5ae6370241e5 with Priority: HIGHEST for action port [ 1138.324450] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a1bc13c-6f6b-4407-bdaa-5ae6370241e5 with Priority: HIGHEST for action port [ 1138.324643] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a1bc13c-6f6b-4407-bdaa-5ae6370241e5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.324771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a1bc13c-6f6b-4407-bdaa-5ae6370241e5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.324838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a1bc13c-6f6b-4407-bdaa-5ae6370241e5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.325131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a1bc13c-6f6b-4407-bdaa-5ae6370241e5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.325216] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a1bc13c-6f6b-4407-bdaa-5ae6370241e5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.348761] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.348961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.349032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.349202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.349293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.349892] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.349892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.349892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.349892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.349892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.350224] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1138.380677] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.380919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.380919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.381176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.381348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.391707] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1138.829070] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a1bc13c-6f6b-4407-bdaa-5ae6370241e5 [ 1138.829328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.829467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.829538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.829752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.829839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.829935] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a1bc13c-6f6b-4407-bdaa-5ae6370241e5 already deleted. [ 1138.830028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a1bc13c-6f6b-4407-bdaa-5ae6370241e5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.803171] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1139.803486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.096144] env[65161]: INFO networking_nsxv3.common.synchronization [req-64b94ec6-9b9e-4ba9-b393-39472706d0f9 req-8d02fa7e-f809-4aa0-92ef-aedafb3b0947 tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1140.096664] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1140.096942] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.097535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.097619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.097821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.097980] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.098128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.098239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.098408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.098469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.098562] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.401218] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1140.401396] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1140.401475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.494447] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.494645] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.494766] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.495055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.495412] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.495586] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.495783] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.496017] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.496180] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.496406] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.496518] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.496625] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.496732] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.496837] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.496939] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.497081] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.516645] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.516807] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.516943] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.517129] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.517450] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-940dac53-681b-48fd-8506-a25f7ad9a7ab taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.517627] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-940dac53-681b-48fd-8506-a25f7ad9a7ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.517748] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-940dac53-681b-48fd-8506-a25f7ad9a7ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.518094] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-940dac53-681b-48fd-8506-a25f7ad9a7ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.518240] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940dac53-681b-48fd-8506-a25f7ad9a7ab',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.601538] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.601721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.601794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.602038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.602141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.602339] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.602461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.602525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.602813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.602901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.603035] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1140.663647] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.663836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.663883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.664076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.664219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.685305] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1141.021020] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.021429] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.021642] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.021990] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.022218] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.022445] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 940dac53-681b-48fd-8506-a25f7ad9a7ab not found, creating... [ 1141.022770] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.023013] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.023264] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.023546] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.023702] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.023986] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.024172] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.024311] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.024526] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.024661] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.024798] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 940dac53-681b-48fd-8506-a25f7ad9a7ab is going to be created. [ 1141.046641] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.046913] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.047057] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.047332] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.047561] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.047782] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-940dac53-681b-48fd-8506-a25f7ad9a7ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.787589] env[65161]: INFO networking_nsxv3.common.synchronization [req-64b94ec6-9b9e-4ba9-b393-39472706d0f9 req-939547a8-9525-4d26-8f6b-ddb5a67e1bf9 service nova] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 1141.787589] env[65161]: INFO networking_nsxv3.common.synchronization [req-64b94ec6-9b9e-4ba9-b393-39472706d0f9 req-939547a8-9525-4d26-8f6b-ddb5a67e1bf9 service nova] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1141.787863] env[65161]: INFO networking_nsxv3.common.synchronization [req-64b94ec6-9b9e-4ba9-b393-39472706d0f9 req-939547a8-9525-4d26-8f6b-ddb5a67e1bf9 service nova] Enqueued Resource ID: 940dac53-681b-48fd-8506-a25f7ad9a7ab with Priority: HIGHEST for action port [ 1141.788376] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 1141.788533] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1141.788626] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 940dac53-681b-48fd-8506-a25f7ad9a7ab with Priority: HIGHEST for action port [ 1141.788909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.789050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.789122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.789337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.789419] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.790730] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.790830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.791027] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-940dac53-681b-48fd-8506-a25f7ad9a7ab taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.791133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-940dac53-681b-48fd-8506-a25f7ad9a7ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.791193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-940dac53-681b-48fd-8506-a25f7ad9a7ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.791451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-940dac53-681b-48fd-8506-a25f7ad9a7ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.791523] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940dac53-681b-48fd-8506-a25f7ad9a7ab',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.294496] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.294496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.295058] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 940dac53-681b-48fd-8506-a25f7ad9a7ab with status ACTIVE [ 1142.295361] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.295916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.295916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.295916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.295916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.296755] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.297659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.297659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.297659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.297659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.297659] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.297887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.297887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.297944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.298011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.298371] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 940dac53-681b-48fd-8506-a25f7ad9a7ab is going to be updated. [ 1142.321251] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.321409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.321486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.321674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.321851] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.322083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-940dac53-681b-48fd-8506-a25f7ad9a7ab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.696291] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1142.696602] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 deletion is rescheduled due to dependency. [ 1142.696756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.696966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.697467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.699528] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.699824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.700015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.700273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.700395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.701596] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.730175] env[65161]: INFO networking_nsxv3.common.synchronization [req-33e84ee3-d551-486c-932d-b67feea98765 req-db6f82cf-5d53-47b6-ae76-10bc3c0cb353 tempest-ListImageFiltersTestJSON-649465129 tempest-ListImageFiltersTestJSON-649465129-project-member] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1142.730893] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1142.731808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.731808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.731808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.731808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.731808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.732095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.732095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.732163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.732762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.732762] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.203939] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.234761] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.468638] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.468838] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.468959] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.469256] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.469928] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.470118] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.470242] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.470464] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.470613] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.470823] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.470937] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.471059] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.471170] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.471281] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.471388] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.471518] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.491016] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.491233] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.491387] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.491564] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.491884] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.492131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.492269] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.492595] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.492735] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa98745e-ebdb-4a1a-ad08-5cddac90f6c9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.705421] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.737498] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.995166] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.995443] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.995607] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.996107] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.996107] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.996271] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 not found, creating... [ 1143.996565] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.996746] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.996879] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.997065] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.997125] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.997410] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.997582] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.997678] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.997880] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.998023] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.998166] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 is going to be created. [ 1144.023135] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.023385] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.023603] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.023733] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.023972] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.024209] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.208377] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.208832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.208832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.208936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.209030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.209142] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1144.240391] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.240664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.240763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.241076] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.241322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.242936] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.243126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.243231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.243493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.243627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.243768] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72c3d008-c3df-415c-97a1-58c326239709 is going to be updated. [ 1144.253746] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1144.378109] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.378109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.378109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.378320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.378320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.387149] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: IN_PROGRESS for 2s [ 1144.702859] env[65161]: INFO networking_nsxv3.common.synchronization [req-d8694a20-8980-476a-b68b-c3cae7885c32 req-4bf3b8b1-4269-4683-8c49-2c4577c8a25e service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 1144.703058] env[65161]: INFO networking_nsxv3.common.synchronization [req-d8694a20-8980-476a-b68b-c3cae7885c32 req-4bf3b8b1-4269-4683-8c49-2c4577c8a25e service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1144.703229] env[65161]: INFO networking_nsxv3.common.synchronization [req-d8694a20-8980-476a-b68b-c3cae7885c32 req-4bf3b8b1-4269-4683-8c49-2c4577c8a25e service nova] Enqueued Resource ID: aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 with Priority: HIGHEST for action port [ 1144.703441] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 1144.703568] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1144.703664] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 with Priority: HIGHEST for action port [ 1144.704813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.704944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.705022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.705242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.705324] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.706714] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.706714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.706714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.709268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.709432] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.709539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.709596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.709774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.709860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.710620] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.711020] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.711020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.711020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.711235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.711235] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa98745e-ebdb-4a1a-ad08-5cddac90f6c9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.783602] env[65161]: INFO networking_nsxv3.common.synchronization [req-f61534ac-994e-4b3f-8f49-c1e2575b9fe8 req-dbb13715-d66b-4062-87f6-bf0285993635 tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_members [ 1144.784389] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d592aa9d-8cc0-42f6-959d-30654012ec4e with Priority: HIGHEST for action security_group_members [ 1144.784389] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d592aa9d-8cc0-42f6-959d-30654012ec4e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.784605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.784605] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.784700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.784830] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.784927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.784986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.785155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.785285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.785388] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d592aa9d-8cc0-42f6-959d-30654012ec4e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.138990] env[65161]: INFO networking_nsxv3.common.synchronization [req-191deb5b-5d02-4dba-8398-3fe3dede62d7 req-7a53ead2-572c-4b23-83fa-25db35458614 tempest-ServerGroupTestJSON-800960201 tempest-ServerGroupTestJSON-800960201-project-member] Enqueued Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGHEST for action security_group_members [ 1145.140092] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGHEST for action security_group_members [ 1145.140092] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac40d56d-7d37-468b-9192-2bd9518b5b77 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.140092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.140445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.140833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.142554] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.142554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.142554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.142554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.142554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.142554] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.215034] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.215034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.215034] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 with status ACTIVE [ 1145.215034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.215034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.215034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.215805] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.215805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.215805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.218467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.221315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.221315] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 is going to be updated. [ 1145.242301] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.242301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.242301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.242301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.242301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.242301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.436430] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.436606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.436930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.436930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.470969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.472029] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.472029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.472029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.472029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.472029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.472029] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d592aa9d-8cc0-42f6-959d-30654012ec4e is going to be updated. [ 1145.532272] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.532272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.532272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.532686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.532686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.538899] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-320 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.539105] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-320" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.541405] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-320" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.541405] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-320" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.541405] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.541405] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.541405] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.541405] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.541405] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.541405] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.541405] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.541405] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.541405] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.541405] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.541405] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.541405] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.551076] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d592aa9d-8cc0-42f6-959d-30654012ec4e in Status: IN_PROGRESS for 2s [ 1145.580469] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.580469] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1145.580469] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.580469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-320" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.580469] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-578833fd-103b-478e-8135-a122c6f9d0ac taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.580469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-578833fd-103b-478e-8135-a122c6f9d0ac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.580469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-578833fd-103b-478e-8135-a122c6f9d0ac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.580469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-578833fd-103b-478e-8135-a122c6f9d0ac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.580469] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('578833fd-103b-478e-8135-a122c6f9d0ac',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.645394] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.645609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.645693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.645961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.646108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.646706] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.646706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.646706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.646902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.646902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.646902] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 already deleted. [ 1145.647010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.721061] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.090279] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.090521] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.090675] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.091156] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.091156] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.091307] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 578833fd-103b-478e-8135-a122c6f9d0ac not found, creating... [ 1146.091648] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.091825] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.092164] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.092488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.092488] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.092864] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.093156] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.093330] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.093807] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.094520] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.094801] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 578833fd-103b-478e-8135-a122c6f9d0ac is going to be created. [ 1146.130483] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.130681] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.130864] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.131180] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.131415] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.131929] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-578833fd-103b-478e-8135-a122c6f9d0ac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.223626] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.224013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.224013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.224153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.224344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.224344] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be created. [ 1146.267376] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.267630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.267745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.267977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.268153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.270013] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1146.270294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.271066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.271373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.271609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.271774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.271862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.272086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.272209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.272325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.272443] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.278168] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: UNINITIALIZED for 2s [ 1146.396507] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: SUCCESS [ 1146.396740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.775280] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.801657] env[65161]: INFO networking_nsxv3.common.synchronization [req-191deb5b-5d02-4dba-8398-3fe3dede62d7 req-c3941dcd-1d86-46d9-81cc-3fcb2d7c0553 service nova] Enqueued Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGHEST for action security_group_rules [ 1146.802964] env[65161]: INFO networking_nsxv3.common.synchronization [req-191deb5b-5d02-4dba-8398-3fe3dede62d7 req-c3941dcd-1d86-46d9-81cc-3fcb2d7c0553 service nova] Enqueued Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGHEST for action security_group_members [ 1146.802964] env[65161]: INFO networking_nsxv3.common.synchronization [req-191deb5b-5d02-4dba-8398-3fe3dede62d7 req-c3941dcd-1d86-46d9-81cc-3fcb2d7c0553 service nova] Enqueued Resource ID: 578833fd-103b-478e-8135-a122c6f9d0ac with Priority: HIGHEST for action port [ 1146.802964] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGHEST for action security_group_rules [ 1146.802964] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGHEST for action security_group_members [ 1146.802964] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 578833fd-103b-478e-8135-a122c6f9d0ac with Priority: HIGHEST for action port [ 1146.803294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac40d56d-7d37-468b-9192-2bd9518b5b77 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.803294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.803404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.804897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.804897] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.804897] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac40d56d-7d37-468b-9192-2bd9518b5b77 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.805097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.805097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.805572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.805572] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.805697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.805697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.805855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.805924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.806029] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.806858] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-578833fd-103b-478e-8135-a122c6f9d0ac taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.807017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-578833fd-103b-478e-8135-a122c6f9d0ac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.807992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-578833fd-103b-478e-8135-a122c6f9d0ac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.807992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-578833fd-103b-478e-8135-a122c6f9d0ac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.807992] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('578833fd-103b-478e-8135-a122c6f9d0ac',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.277673] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dad00945-a380-4452-8a37-64cfdbf9d432: rpc.has_security_group_logging(os_id): False [ 1147.305935] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.306173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.306173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.306557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.306669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.306948] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.307077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.307209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.307393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.307485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.307598] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1147.308799] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.310358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac40d56d-7d37-468b-9192-2bd9518b5b77 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.310358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.310967] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 578833fd-103b-478e-8135-a122c6f9d0ac with status ACTIVE [ 1147.311154] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.311263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.311327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.311720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.311720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.311720] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.311892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.311922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.312138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.312220] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.312421] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.312531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.312586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.312702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.312769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.312910] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 578833fd-103b-478e-8135-a122c6f9d0ac is going to be updated. [ 1147.363782] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.364043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.364043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.364217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.364350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.364546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-578833fd-103b-478e-8135-a122c6f9d0ac" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.421647] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.421864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.422044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.422348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.422575] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.456561] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1147.568925] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d592aa9d-8cc0-42f6-959d-30654012ec4e in Status: SUCCESS [ 1147.569074] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d592aa9d-8cc0-42f6-959d-30654012ec4e deletion is rescheduled due to dependency. [ 1147.569196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d592aa9d-8cc0-42f6-959d-30654012ec4e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.811605] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.289726] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1148.290097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.290097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.290325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.290515] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.290637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.290701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.290862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.290942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.291043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.291137] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.315879] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.316089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.316157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.316491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.316615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.316743] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 is going to be created. [ 1148.333518] env[65161]: INFO networking_nsxv3.common.synchronization [req-3dd7db0a-e6de-4d6e-8a5b-2855e81a470c req-9bc45478-2910-47ef-aa4f-6d739ee4cb98 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1148.334219] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1148.334527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.334659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.334745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.334977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.335182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.335366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.335462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.335634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.335722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.335820] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.348776] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.348776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.348975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.349085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.349238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.362523] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 in Status: UNINITIALIZED for 2s [ 1148.672754] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.672953] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.673108] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.673397] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.673661] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.673813] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.674026] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.674261] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.674405] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.674622] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.674717] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.674812] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.674916] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.675031] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.675133] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.675300] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.694563] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.694741] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.694878] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.695070] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.695531] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.695745] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.695873] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.696227] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.696371] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d9b7d4f-f18c-4480-a043-9e0b9d6abec7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.793733] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.793901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.793947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.794248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.794417] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.794517] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.794579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.794736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.794822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.794905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.795065] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.795161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.795210] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.795467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.795603] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.795696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.795756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.795892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.795969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.796064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.796151] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.838610] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.838767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.838836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.839071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.839157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.839416] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.839551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.839595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.839754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.839834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.839919] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1148.877274] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.877788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.877891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.878061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.878204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.889018] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1149.198685] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.198912] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.198912] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.199202] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.199350] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.199504] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 8d9b7d4f-f18c-4480-a043-9e0b9d6abec7 not found, creating... [ 1149.199925] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.200126] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.200248] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.200472] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.200673] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.200984] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.201176] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.201294] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.201501] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.201628] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.201769] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 8d9b7d4f-f18c-4480-a043-9e0b9d6abec7 is going to be created. [ 1149.222021] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.222253] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.222380] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.222660] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.222882] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.223118] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.300885] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 200ba9e0-f56c-4b5d-9e39-69a507140fda: rpc.has_security_group_logging(os_id): False [ 1149.322730] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.322925] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.322971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.323217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.323332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.323545] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.323667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.323762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.323853] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.323929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.324350] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.324522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.324594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.324909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.324991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.325200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.325357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.325426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.325571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.325646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.325733] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be created. [ 1149.408561] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.408797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.408797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.408988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.409173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.420623] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1149.471950] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1149.472206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.948519] env[65161]: INFO networking_nsxv3.common.synchronization [req-3dd7db0a-e6de-4d6e-8a5b-2855e81a470c req-69787715-3951-403f-b6a2-ebda5a0bfc27 service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1149.948732] env[65161]: INFO networking_nsxv3.common.synchronization [req-3dd7db0a-e6de-4d6e-8a5b-2855e81a470c req-69787715-3951-403f-b6a2-ebda5a0bfc27 service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1149.948871] env[65161]: INFO networking_nsxv3.common.synchronization [req-3dd7db0a-e6de-4d6e-8a5b-2855e81a470c req-69787715-3951-403f-b6a2-ebda5a0bfc27 service nova] Enqueued Resource ID: 8d9b7d4f-f18c-4480-a043-9e0b9d6abec7 with Priority: HIGHEST for action port [ 1149.949413] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1149.949548] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1149.949642] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9b7d4f-f18c-4480-a043-9e0b9d6abec7 with Priority: HIGHEST for action port [ 1149.949903] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.950332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.950421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.950628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.950710] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.951957] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.952067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.952263] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.952576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.952673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.952849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.952928] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d9b7d4f-f18c-4480-a043-9e0b9d6abec7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.373726] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 in Status: SUCCESS [ 1150.374790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.374933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.375449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.376237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.376437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.376591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.376844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.376940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.377056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.377205] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.456246] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.456361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.456489] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d9b7d4f-f18c-4480-a043-9e0b9d6abec7 with status ACTIVE [ 1150.456658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.456763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.456824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.457057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.457767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.457767] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.458109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.458109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.458202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.459615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.459615] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.459615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.459615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.459615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.459615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.459615] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d9b7d4f-f18c-4480-a043-9e0b9d6abec7 is going to be updated. [ 1150.484267] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.484267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.484267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.484267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.484551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.484551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d9b7d4f-f18c-4480-a043-9e0b9d6abec7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.621173] env[65161]: INFO networking_nsxv3.common.synchronization [req-54f0f7cb-dd61-444c-b4a6-8662e5939e25 req-cdf1d35d-c4d7-4d99-9daf-4e5da99bb89e tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1150.622189] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1150.622535] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.622652] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.622724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.622926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.623103] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.623262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.623370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.623535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.623623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.623717] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.879682] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac40d56d-7d37-468b-9192-2bd9518b5b77 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.879902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.879953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.880187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.880370] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.881024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.881024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.881024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.881024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.881024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.881024] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac40d56d-7d37-468b-9192-2bd9518b5b77 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.881428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.881428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.881428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.881542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.881588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.881619] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.884016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.884016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.884016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.884016] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.900429] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1150.900657] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1150.900848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.901352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.901616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.901813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.901943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.902013] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.902201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.902288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.902390] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.042297] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.042297] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.043244] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.043244] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.043914] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.043914] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.044065] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.044805] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.044805] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.044936] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.045963] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.045963] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.045963] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.045963] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.045963] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.045963] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.069212] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.069375] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1151.069513] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.069783] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.070113] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-6482ab58-97ce-49ab-b767-6f172249a4d7 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.071242] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-6482ab58-97ce-49ab-b767-6f172249a4d7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.071242] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-6482ab58-97ce-49ab-b767-6f172249a4d7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.071242] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-6482ab58-97ce-49ab-b767-6f172249a4d7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.071242] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6482ab58-97ce-49ab-b767-6f172249a4d7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.125731] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.384613] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac40d56d-7d37-468b-9192-2bd9518b5b77: rpc.has_security_group_logging(os_id): False [ 1151.402191] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.402493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.402608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.402821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.402910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.403160] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.403258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.403342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.403469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.403544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.403718] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.403811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.403870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.404009] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.404085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.404268] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.404419] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.404480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.404616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.404688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.404771] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 is going to be created. [ 1151.405964] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.433430] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1151.433653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.469988] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.470150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.470221] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.470430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.470641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.480710] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 in Status: IN_PROGRESS for 2s [ 1151.573505] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.573782] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.573856] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.574176] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.574327] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.574481] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 6482ab58-97ce-49ab-b767-6f172249a4d7 not found, creating... [ 1151.574753] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.574909] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.575036] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.575259] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.575477] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.575764] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.575935] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.576040] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.576247] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.576428] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.576584] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 6482ab58-97ce-49ab-b767-6f172249a4d7 is going to be created. [ 1151.617539] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.617763] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.617932] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.618202] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.618484] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.618697] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-6482ab58-97ce-49ab-b767-6f172249a4d7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.628185] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.909195] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.130930] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.131102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.131163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.131380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.131471] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.131566] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1152.158178] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.158325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.158391] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.158602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.158741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.169125] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1152.305943] env[65161]: INFO networking_nsxv3.common.synchronization [req-54f0f7cb-dd61-444c-b4a6-8662e5939e25 req-2959f8d1-4094-43ce-a1ed-d2a4012f7645 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1152.305943] env[65161]: INFO networking_nsxv3.common.synchronization [req-54f0f7cb-dd61-444c-b4a6-8662e5939e25 req-2959f8d1-4094-43ce-a1ed-d2a4012f7645 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1152.305943] env[65161]: INFO networking_nsxv3.common.synchronization [req-54f0f7cb-dd61-444c-b4a6-8662e5939e25 req-2959f8d1-4094-43ce-a1ed-d2a4012f7645 service nova] Enqueued Resource ID: 6482ab58-97ce-49ab-b767-6f172249a4d7 with Priority: HIGHEST for action port [ 1152.305943] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1152.305943] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1152.305943] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6482ab58-97ce-49ab-b767-6f172249a4d7 with Priority: HIGHEST for action port [ 1152.305943] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.306456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.306456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.306456] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.306691] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.307585] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.307760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.307917] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-6482ab58-97ce-49ab-b767-6f172249a4d7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.308056] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6482ab58-97ce-49ab-b767-6f172249a4d7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.308349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6482ab58-97ce-49ab-b767-6f172249a4d7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.308349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6482ab58-97ce-49ab-b767-6f172249a4d7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.308608] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6482ab58-97ce-49ab-b767-6f172249a4d7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.411768] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.412125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.412125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.412247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.412318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.412445] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1152.442237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.442372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.442440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.442641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.442778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.452253] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1152.811038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.811230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.811283] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6482ab58-97ce-49ab-b767-6f172249a4d7 with status ACTIVE [ 1152.811451] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.811560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.811626] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.811836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.811924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.812542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.812542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.812542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.812542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.812542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.812790] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.812790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.812866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.812974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.813133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.813263] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6482ab58-97ce-49ab-b767-6f172249a4d7 is going to be updated. [ 1152.836333] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.836333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.836333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.836333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.836333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.836333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6482ab58-97ce-49ab-b767-6f172249a4d7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.496346] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 in Status: SUCCESS [ 1153.496669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.179382] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1154.179660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.179783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.180085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.180327] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.180477] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.180549] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.180747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.180855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.180975] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.466895] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1154.466895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.466895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.467163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.467163] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.467330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.467330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.467500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.467594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.467685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.467793] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.684055] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.970462] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.970667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.970734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.970902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.971084] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.971193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.971264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.972150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.972150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.972150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.972150] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.972150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.972150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.972409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.972409] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.972538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.972569] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.972728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.972805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.972884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.972992] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.186506] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.202306] env[65161]: INFO networking_nsxv3.common.synchronization [req-c73afcbf-b566-47f3-a6c9-5559d3010ece req-1907b829-fb73-46f9-9134-073048b6e514 tempest-ListImageFiltersTestJSON-649465129 tempest-ListImageFiltersTestJSON-649465129-project-member] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1155.202306] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGHEST for action security_group_members [ 1155.202532] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.202687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.203115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.203115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.203115] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.203275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.203275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.203418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.203495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.203581] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.476720] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ad3588-f61e-418d-9a8e-c65add44c1be: rpc.has_security_group_logging(os_id): False [ 1155.494358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.494444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.494510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.494705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.494772] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.494992] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.495103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.495163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.495310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.495438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.495684] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.495807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.495867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.496024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.496086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.496269] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.496390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.496484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.496587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.496665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.496754] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1155.567816] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.568074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.568165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.568465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.568681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.584384] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1155.689333] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.689717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.689717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.689717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.689810] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.689919] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1155.706151] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.706341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.706416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.706630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.706724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.707125] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.707347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.707412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.707585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.707667] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.707763] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72c3d008-c3df-415c-97a1-58c326239709 is going to be updated. [ 1155.739854] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.739854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.739854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.739854] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.740169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.742214] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.742370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.742405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.743047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.743047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.754285] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: IN_PROGRESS for 2s [ 1155.754981] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1157.597244] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1157.597606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.767622] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72c3d008-c3df-415c-97a1-58c326239709 in Status: SUCCESS [ 1157.767762] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72c3d008-c3df-415c-97a1-58c326239709 deletion is rescheduled due to dependency. [ 1157.767872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.768591] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1157.768758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.768924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.769161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.769312] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.769429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.769497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.769649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.769728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.769833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.769918] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.272777] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.272940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.273029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.273258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.273433] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.273540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.273604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.273790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.273895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.273986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.274153] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.274245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.274303] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.274440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.274576] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.274664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.274725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.274858] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.274929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.275016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.275109] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.778246] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caaaa94-1988-4a64-baf8-2e9ad4c3a553: rpc.has_security_group_logging(os_id): False [ 1158.796499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.796705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.796705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.796911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.797016] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.797219] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.797331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.797402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.797574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.797686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.797914] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.798036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.798110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.798269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.798415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.798537] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.798649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.798713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.798915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.799047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.799143] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1158.860499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.860658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.860734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.860949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.861116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.873939] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1159.273618] env[65161]: INFO networking_nsxv3.common.synchronization [req-386fa1d1-5c90-41a7-881a-ff927bf47ad5 req-789ac646-b2a3-43a3-84de-79be4aec327c tempest-ServerGroupTestJSON-800960201 tempest-ServerGroupTestJSON-800960201-project-member] Enqueued Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGHEST for action security_group_members [ 1159.273618] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGHEST for action security_group_members [ 1159.273874] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac40d56d-7d37-468b-9192-2bd9518b5b77 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.273874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.273874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.274195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.274385] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.274496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.274557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.274845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.274971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.275142] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.777505] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.777820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.778872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.779215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.779269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.779466] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.779607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.780541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.780541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.780541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.780541] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 is going to be updated. [ 1159.804412] env[65161]: INFO networking_nsxv3.common.synchronization [req-ce997fe0-6164-4c43-aa35-13937a7c2774 req-2aa75b17-0d39-459d-8444-3c6f206b3f61 tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 1159.806110] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 1159.806110] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.806110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.806110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.806286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.806401] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.806503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.806576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.806733] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.810042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.810042] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.825092] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.825240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.825311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.825943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.825943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.838573] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 in Status: IN_PROGRESS for 2s [ 1160.136913] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.137134] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.137280] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.137640] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.138406] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.138622] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.138748] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.138990] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.139161] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.139375] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1160.139550] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.139708] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.139821] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.139993] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1160.140136] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.140270] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.162046] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.162046] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1160.162046] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.162046] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.162046] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-9e0b5c62-27d0-4ffa-b971-f973f1326565 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.162046] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.162046] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.162046] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.162046] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e0b5c62-27d0-4ffa-b971-f973f1326565',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.311930] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.312096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.312168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.312381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.312470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.312654] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.312750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.312807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.312950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.313037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.313125] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be deleted. [ 1160.354492] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.354841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.354917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.355188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.355236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.355369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.646250] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-57 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.646563] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.646634] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.646915] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.647220] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.647403] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.647549] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.647795] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.647949] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.648209] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1160.648332] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.648455] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.648567] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.648733] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1160.648818] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.648949] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.665081] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.665081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.665081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.665494] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.665712] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.665931] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 9e0b5c62-27d0-4ffa-b971-f973f1326565 not found, creating... [ 1160.666277] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.666491] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.666640] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.666945] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.667152] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.667516] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.667711] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.667866] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.668159] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.668350] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.668537] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 9e0b5c62-27d0-4ffa-b971-f973f1326565 is going to be created. [ 1160.670561] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.670751] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1160.670926] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.671137] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-57" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.671459] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.671669] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.671823] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.672109] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.672288] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa98745e-ebdb-4a1a-ad08-5cddac90f6c9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.698075] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.698291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.698409] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.698689] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.698919] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.699181] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.892639] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1160.893021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.176269] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.176269] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.176269] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.177125] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.177125] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.177125] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.177125] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.177125] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.177528] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.177731] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.178043] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.178225] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.178318] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.178550] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.178652] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.178807] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 is going to be updated. [ 1161.206278] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.206553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.206634] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.206917] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.207123] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.207343] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.427924] env[65161]: INFO networking_nsxv3.common.synchronization [req-ce997fe0-6164-4c43-aa35-13937a7c2774 req-0e98adfc-2842-451e-bbe1-2ad68b6ea61c service nova] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_rules [ 1161.428133] env[65161]: INFO networking_nsxv3.common.synchronization [req-ce997fe0-6164-4c43-aa35-13937a7c2774 req-0e98adfc-2842-451e-bbe1-2ad68b6ea61c service nova] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 1161.428273] env[65161]: INFO networking_nsxv3.common.synchronization [req-ce997fe0-6164-4c43-aa35-13937a7c2774 req-0e98adfc-2842-451e-bbe1-2ad68b6ea61c service nova] Enqueued Resource ID: 9e0b5c62-27d0-4ffa-b971-f973f1326565 with Priority: HIGHEST for action port [ 1161.428809] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_rules [ 1161.428955] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 1161.429052] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0b5c62-27d0-4ffa-b971-f973f1326565 with Priority: HIGHEST for action port [ 1161.433411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.433411] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.433411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.433411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.433411] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.433411] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e0b5c62-27d0-4ffa-b971-f973f1326565 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.433411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.434182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.434182] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e0b5c62-27d0-4ffa-b971-f973f1326565',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.848855] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 in Status: SUCCESS [ 1161.848855] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 deletion is rescheduled due to dependency. [ 1161.848855] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.895720] env[65161]: INFO networking_nsxv3.common.synchronization [req-d3d2bbf8-b3a4-45ee-b6d5-a3692a5c8cd8 req-c635c1d8-cf25-437b-94a3-d4743ca4b6ec service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 1161.895967] env[65161]: INFO networking_nsxv3.common.synchronization [req-d3d2bbf8-b3a4-45ee-b6d5-a3692a5c8cd8 req-c635c1d8-cf25-437b-94a3-d4743ca4b6ec service nova] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1161.896073] env[65161]: INFO networking_nsxv3.common.synchronization [req-d3d2bbf8-b3a4-45ee-b6d5-a3692a5c8cd8 req-c635c1d8-cf25-437b-94a3-d4743ca4b6ec service nova] Enqueued Resource ID: aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 with Priority: HIGHEST for action port [ 1161.896503] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_rules [ 1161.896634] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1161.896729] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 with Priority: HIGHEST for action port [ 1161.896993] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.897116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.897183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.897386] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.897467] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.898295] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.899242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.899242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.899242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.899242] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.899242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.899242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.899242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.899242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.899242] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.899999] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.900073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.900193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.900300] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.900359] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa98745e-ebdb-4a1a-ad08-5cddac90f6c9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.934931] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.936240] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.936240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.936240] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e0b5c62-27d0-4ffa-b971-f973f1326565 with status ACTIVE [ 1161.936409] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.936512] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.936571] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.936769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.936910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.937633] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.937633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.937633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.937633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.937633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.937633] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.938052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.938052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.938052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.938052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.938052] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e0b5c62-27d0-4ffa-b971-f973f1326565 is going to be updated. [ 1161.961450] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.961450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.961450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.961450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.961764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.961764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.402514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.402663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.402836] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.403801] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 with status ACTIVE [ 1162.403983] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.404117] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.404184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.404390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.404493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.404671] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.404768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.405707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.405707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.405707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.405707] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.406057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.406057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.406057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.406057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.406429] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa98745e-ebdb-4a1a-ad08-5cddac90f6c9 is going to be updated. [ 1162.426547] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.426734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.426777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.426964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.427109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.427262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa98745e-ebdb-4a1a-ad08-5cddac90f6c9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.440324] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.908428] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.942595] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.942830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.943440] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.943782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.943918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.944043] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be created. [ 1162.970425] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.970647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.970692] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.970956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.971189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.981873] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: UNINITIALIZED for 2s [ 1163.410870] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.411112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.411161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.411454] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.411599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.411707] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be updated. [ 1163.446621] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.446920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.446920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.447502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.447502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.459931] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1164.374267] env[65161]: INFO networking_nsxv3.common.synchronization [req-bf99f0e6-93dc-4078-8cf7-4f277f8ce5fb req-8cffc773-bcf7-4103-ac25-ca23b8420b99 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1164.375589] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1164.375589] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.375589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.375589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.375888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.375888] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.375996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.376068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.376229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.376381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.376602] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.881966] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.882293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.882378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.882606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.882710] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.883759] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.883759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.883759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.883759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.883759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.883759] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1164.911237] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.911375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.911449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.911659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.911800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.921521] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1164.997936] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: SUCCESS [ 1164.997936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.997936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.997936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.997936] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.997936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.997936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.997936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.997936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.997936] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.997936] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.291909] env[65161]: INFO networking_nsxv3.common.synchronization [req-73ec4eb0-fd63-4124-979f-5f5472984c25 req-2ebdc67f-2c39-4a26-95ec-14aad86daf57 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1165.292580] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1165.292921] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.293873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.293873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.293873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.293873] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.294157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.294157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.295033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.295033] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.295033] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.360969] env[65161]: INFO networking_nsxv3.common.synchronization [None req-7d1943ee-9d4a-4f0d-bd1c-bd301f54377c None None] Enqueued Resource ID: 122de0f6-984b-47fc-8559-0453e15b09a0 with Priority: HIGHEST for action port [ 1165.361227] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122de0f6-984b-47fc-8559-0453e15b09a0 with Priority: HIGHEST for action port [ 1165.361871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-122de0f6-984b-47fc-8559-0453e15b09a0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.361871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-122de0f6-984b-47fc-8559-0453e15b09a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.361871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-122de0f6-984b-47fc-8559-0453e15b09a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.362152] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-122de0f6-984b-47fc-8559-0453e15b09a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.362231] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('122de0f6-984b-47fc-8559-0453e15b09a0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.469990] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1165.470335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.470683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.470773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.470943] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.471083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.471148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.471332] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.471412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.471599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.471649] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.500701] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.500701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.500701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.501529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.501743] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.501866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.501935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.502176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.502399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.502399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.502517] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.502597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.502597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.502735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.502875] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.502962] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.503024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.503166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.503238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.503313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.503400] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.797553] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.866294] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 122de0f6-984b-47fc-8559-0453e15b09a0 [ 1165.866294] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.866294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.866294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.866680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.866680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.866744] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:122de0f6-984b-47fc-8559-0453e15b09a0 already deleted. [ 1165.866870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-122de0f6-984b-47fc-8559-0453e15b09a0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.974279] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.974402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.974402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.974852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.974852] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.974934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.975009] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.975198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.975304] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.975402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.975645] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.975776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.975812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.975969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.976154] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.976273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.976358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.976535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.976643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.976748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.976867] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.006248] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f6a93f2-4e06-4cd8-9bde-77501efa88f4: rpc.has_security_group_logging(os_id): False [ 1166.027153] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.027307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.027377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.027606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.027697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.028420] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.028420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.028420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.028420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.028420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.028671] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.028671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.028671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.029334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.029334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.029334] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.029334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.029334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.029334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.030822] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.030822] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be created. [ 1166.119028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.119028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.119028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.119028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.119028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.132178] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: IN_PROGRESS for 2s [ 1166.303026] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.479970] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 200ba9e0-f56c-4b5d-9e39-69a507140fda: rpc.has_security_group_logging(os_id): False [ 1166.500828] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.500828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.500828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.501117] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.501117] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.501221] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.501305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.501379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.501531] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.502732] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.502732] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.502732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.503181] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be updated. [ 1166.568037] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.568037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.568037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.568335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.568473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.587149] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1166.804060] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.804225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.804267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.804483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.804595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.804685] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1166.836770] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.836931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.837008] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.837247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.837443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.848467] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1166.941506] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1166.941506] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1166.941506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.531746] env[65161]: INFO networking_nsxv3.common.synchronization [None req-5a2257a3-e7bb-4ef8-b852-620e9a5951be None None] Enqueued Resource ID: 54555e11-ba79-408b-93bb-1ef561638f34 with Priority: HIGHEST for action port [ 1167.532327] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54555e11-ba79-408b-93bb-1ef561638f34 with Priority: HIGHEST for action port [ 1167.532637] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-54555e11-ba79-408b-93bb-1ef561638f34 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.532763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54555e11-ba79-408b-93bb-1ef561638f34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.532831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54555e11-ba79-408b-93bb-1ef561638f34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.533915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54555e11-ba79-408b-93bb-1ef561638f34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.534073] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54555e11-ba79-408b-93bb-1ef561638f34',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.037977] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54555e11-ba79-408b-93bb-1ef561638f34 [ 1168.038219] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.038497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.038497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.038642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.038721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.038817] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54555e11-ba79-408b-93bb-1ef561638f34 already deleted. [ 1168.038918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54555e11-ba79-408b-93bb-1ef561638f34" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.144953] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: SUCCESS [ 1168.145148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.604019] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1168.604394] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.807438] env[65161]: INFO networking_nsxv3.common.synchronization [req-55801c3a-2859-43fc-9394-2accde893d02 req-c4e8c4da-f15b-42c2-b007-5ccab05f327b tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 1168.808020] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGHEST for action security_group_members [ 1168.808357] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.808484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.809072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.809072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.809167] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.809883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.809883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.809883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.809883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.809883] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.853139] env[65161]: INFO networking_nsxv3.common.synchronization [req-55801c3a-2859-43fc-9394-2accde893d02 req-c4e8c4da-f15b-42c2-b007-5ccab05f327b tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: 9e0b5c62-27d0-4ffa-b971-f973f1326565 with Priority: HIGHEST for action port [ 1168.853139] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0b5c62-27d0-4ffa-b971-f973f1326565 with Priority: HIGHEST for action port [ 1168.853583] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e0b5c62-27d0-4ffa-b971-f973f1326565 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.853865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.854212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.855919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.855919] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e0b5c62-27d0-4ffa-b971-f973f1326565',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.860807] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1168.860928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.312043] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.312224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.312224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.312425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.312524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.312889] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.312988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.313096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.313223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.313298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.313385] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be updated. [ 1169.340498] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.340657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.340698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.340913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.341070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.350430] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: IN_PROGRESS for 2s [ 1169.357831] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e0b5c62-27d0-4ffa-b971-f973f1326565 with status ACTIVE [ 1169.358063] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.358193] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.358282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.358480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.358592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.358785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.358901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.358947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.359089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.359167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.359345] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.359442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.359504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.359639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.359715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.359798] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e0b5c62-27d0-4ffa-b971-f973f1326565 is going to be updated. [ 1169.377627] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.377806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.377846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.378143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.378286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.378443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e0b5c62-27d0-4ffa-b971-f973f1326565" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.360450] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 in Status: SUCCESS [ 1171.360773] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 deletion is rescheduled due to dependency. [ 1171.360773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.463954] env[65161]: INFO networking_nsxv3.common.synchronization [req-abd457a8-b0b9-411d-9c23-d9d80db0ac57 req-60bd614a-e850-45da-9918-ca2bc1a0e155 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1172.464342] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1172.464670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.464815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.464879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.465172] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.466909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.467043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.467098] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.467269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.467374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.467476] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.838861] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-153 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.839089] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-153" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.839221] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-153" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.839598] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-153" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.839891] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.840082] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.840204] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.840439] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.840587] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.840807] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.840924] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.841066] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.841145] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.841253] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.841355] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.841487] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.862984] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.863236] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1172.863391] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.863636] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-153" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.864320] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.864514] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.866133] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.866133] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.866133] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a822607e-3f2e-4e33-a9fb-94e8ea93ffa3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.970013] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.970232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.970232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.970398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.970486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.970680] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.970787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.970850] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.971010] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.971094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.971182] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 already deleted. [ 1172.971262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.368800] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.369922] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.369922] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.369922] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.370086] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.370234] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 not found, creating... [ 1173.370624] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.370903] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.371115] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.371452] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.371694] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.372077] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.372321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.372494] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.372789] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.372992] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.373228] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 is going to be created. [ 1173.395326] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.395605] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.395809] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.396207] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.396500] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.396786] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.073427] env[65161]: INFO networking_nsxv3.common.synchronization [req-abd457a8-b0b9-411d-9c23-d9d80db0ac57 req-32410db9-c019-4f9b-a488-0c2c4a31b9c8 service nova] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_rules [ 1174.073671] env[65161]: INFO networking_nsxv3.common.synchronization [req-abd457a8-b0b9-411d-9c23-d9d80db0ac57 req-32410db9-c019-4f9b-a488-0c2c4a31b9c8 service nova] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1174.073763] env[65161]: INFO networking_nsxv3.common.synchronization [req-abd457a8-b0b9-411d-9c23-d9d80db0ac57 req-32410db9-c019-4f9b-a488-0c2c4a31b9c8 service nova] Enqueued Resource ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with Priority: HIGHEST for action port [ 1174.074289] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_rules [ 1174.074418] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1174.074514] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with Priority: HIGHEST for action port [ 1174.074785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.074887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.074980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.078334] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.078431] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.079424] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.079546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.079611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.079784] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.079979] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.080094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.080158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.080302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.080384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.080473] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.081825] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.083807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.083920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.084117] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.084195] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a822607e-3f2e-4e33-a9fb-94e8ea93ffa3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.211685] env[65161]: INFO networking_nsxv3.common.synchronization [req-bbba5a23-9fb6-4c5d-b8f1-1a84f01b10a8 req-8d64e78c-580a-4bd6-bdad-c56bb728164a tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_members [ 1174.212300] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGHEST for action security_group_members [ 1174.212609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e2ddd89-773b-40cd-95c8-c99371221138 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.212902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.212902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.213578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.216115] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.216311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.216391] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.216520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.216609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.216724] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.586244] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.587670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.587670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.588017] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with status ACTIVE [ 1174.588017] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.588017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.588194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.588269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.588683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.588683] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.588683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.588683] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.588873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.588873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.593198] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.593267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.593556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.593556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.593654] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.593683] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 is going to be updated. [ 1174.620235] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.620473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.620473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.620631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.620791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.621038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.719926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.719926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.719926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.720203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.720256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.720457] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.720558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.720622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.720775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.720852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.720937] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e2ddd89-773b-40cd-95c8-c99371221138 is going to be updated. [ 1174.734505] env[65161]: INFO networking_nsxv3.common.synchronization [req-dafd6a3c-8392-4d60-80e7-a5c212daa6e4 req-a8e46a00-f31f-435a-95dc-b5320ceb6dd8 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1174.735204] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1174.735459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.735579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.735708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.735932] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.736144] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.736249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.736305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.736459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.736542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.736639] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.752952] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.753390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.753681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.753763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.753968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.774255] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e2ddd89-773b-40cd-95c8-c99371221138 in Status: IN_PROGRESS for 2s [ 1175.041764] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.042075] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.042246] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.042549] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.042846] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.043066] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.043219] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.043464] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.043642] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.043879] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.044040] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.044182] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.044313] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.044446] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.044591] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.044747] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.064107] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.064284] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.064425] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.064593] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.064899] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.065080] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.065199] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.065523] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.065719] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.095458] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.240932] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.241104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.241223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.241383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.241493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.241677] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.241764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.241830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.241998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.242085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.242558] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1175.286208] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.286845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.286845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.286996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.288507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.302114] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1175.571306] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.571634] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.571770] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.572068] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.572221] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.572374] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d not found, creating... [ 1175.572631] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.572787] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.572904] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.573135] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.573272] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.573548] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.573695] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.573807] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.574018] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.574155] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.574295] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d is going to be created. [ 1175.593609] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.593830] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.593997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.594321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.594632] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.594845] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.599669] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.599775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.599842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.600034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.600119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.600211] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be created. [ 1175.623871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.624154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.624239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.624464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.624630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.634331] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: UNINITIALIZED for 2s [ 1176.309068] env[65161]: INFO networking_nsxv3.common.synchronization [req-dafd6a3c-8392-4d60-80e7-a5c212daa6e4 req-7cc59b80-bc2b-4e92-a586-092767fddb15 service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1176.309390] env[65161]: INFO networking_nsxv3.common.synchronization [req-dafd6a3c-8392-4d60-80e7-a5c212daa6e4 req-7cc59b80-bc2b-4e92-a586-092767fddb15 service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1176.309548] env[65161]: INFO networking_nsxv3.common.synchronization [req-dafd6a3c-8392-4d60-80e7-a5c212daa6e4 req-7cc59b80-bc2b-4e92-a586-092767fddb15 service nova] Enqueued Resource ID: 029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d with Priority: HIGHEST for action port [ 1176.310383] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1176.310383] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1176.310501] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d with Priority: HIGHEST for action port [ 1176.311018] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.311018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.311018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.311269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.311379] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.312225] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.312324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.312595] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.312595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.312801] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.312879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.312913] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.787327] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e2ddd89-773b-40cd-95c8-c99371221138 in Status: SUCCESS [ 1176.787327] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e2ddd89-773b-40cd-95c8-c99371221138 deletion is rescheduled due to dependency. [ 1176.787505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.814977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.815140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.815380] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d with status ACTIVE [ 1176.815575] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.815728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.815832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.816047] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.816143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.816316] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.816412] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.816474] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.816644] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.816722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.816931] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.817036] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.817114] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.817250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.817362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.817410] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d is going to be updated. [ 1176.847671] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.847992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.847992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.848204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.848383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.848554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-029ed120-d5b7-4eb0-bfeb-1e4ab9a3e35d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.029427] env[65161]: INFO networking_nsxv3.common.synchronization [req-6656b801-ded4-4a86-9f57-af465675004c req-092f3394-ebe5-43b8-ad5e-88fc597db042 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1177.029773] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1177.029959] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.030088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.030212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.030516] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.030710] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.030825] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.030891] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.031070] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.031155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.031250] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.059387] env[65161]: INFO networking_nsxv3.common.synchronization [req-781d0060-8da5-4afa-a92f-a599802063cd req-8a3d548a-c66c-4614-a0e7-13edd6d7b442 tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1177.059909] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1177.060227] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.060347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.060411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.060606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.060755] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.060849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.060903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.061059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.061139] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.061227] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.313200] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1177.313535] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1177.313535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.313669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.314041] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.314242] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.314367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.314433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.314658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.314756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.314868] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.383387] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.383612] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.383743] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.384030] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.384289] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.384446] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.384562] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.384808] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.384948] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.385183] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.385290] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.385398] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.385503] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.385623] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.386038] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.386038] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.406756] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.407017] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1177.407166] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.407394] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-530" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.407806] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.408057] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.408221] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.408634] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.408820] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.534500] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.564033] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.648410] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: SUCCESS [ 1177.649015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.649167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.649390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.649578] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.650309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.650309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.650309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.650309] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.650570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.650708] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.816954] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.911678] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.911896] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.912038] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.912328] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.912481] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.912638] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2 not found, creating... [ 1177.912898] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.913083] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.913206] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.913426] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.913564] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.914057] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.914271] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.914368] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.914585] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.914726] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.914867] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2 is going to be created. [ 1177.936356] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.936560] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.936660] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.937029] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.937267] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.937485] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.037600] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.065999] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.152768] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.153066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.153066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.153300] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.153892] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.154129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.154209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.154472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.154604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.154714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.154919] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.155042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.155127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.155317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.155485] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.155591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.155655] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.155866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.155954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.156049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.156156] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.321067] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.539850] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.540000] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.540093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.540365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.540442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.540533] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1178.571871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.571871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.571871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.572151] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.572195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.572305] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 is going to be updated. [ 1178.575153] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.575324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.575382] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.575585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.575800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.585400] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1178.609785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.609785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.609785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.610017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.610116] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.621450] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: IN_PROGRESS for 2s [ 1178.658700] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65d0a279-7bb5-4571-b896-e799f6c734a9: rpc.has_security_group_logging(os_id): False [ 1178.677120] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.677289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.677346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.677537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.677630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.677821] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.678264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.678374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.678548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.678629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.678833] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.679031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.679031] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.679160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.679233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.679422] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.679515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.679567] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.679834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.679834] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.683088] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be created. [ 1178.706209] env[65161]: INFO networking_nsxv3.common.synchronization [req-6656b801-ded4-4a86-9f57-af465675004c req-4ed25772-8643-4b30-8e39-bcd8a9d27463 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1178.706392] env[65161]: INFO networking_nsxv3.common.synchronization [req-6656b801-ded4-4a86-9f57-af465675004c req-4ed25772-8643-4b30-8e39-bcd8a9d27463 service nova] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1178.706528] env[65161]: INFO networking_nsxv3.common.synchronization [req-6656b801-ded4-4a86-9f57-af465675004c req-4ed25772-8643-4b30-8e39-bcd8a9d27463 service nova] Enqueued Resource ID: 2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2 with Priority: HIGHEST for action port [ 1178.707142] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_rules [ 1178.707279] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1178.707374] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2 with Priority: HIGHEST for action port [ 1178.707678] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.707769] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.707904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.708049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.708130] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.709127] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.709241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.709428] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.709536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.709601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.709803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.710377] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.751021] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.751021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.751021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.751021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.751021] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.761858] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: IN_PROGRESS for 2s [ 1178.825533] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.825533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.825533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.825533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.825533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.825533] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1178.872238] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.872238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.872238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.872238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.872238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.889298] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1179.125462] env[65161]: INFO networking_nsxv3.common.synchronization [None req-8dc79c7f-f1ab-41aa-a056-7ed7b3d90887 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_rules [ 1179.126088] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_rules [ 1179.126405] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a3857b-abc1-464f-9b15-c97784bb1930 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.126541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.126640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.126848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.126925] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.212244] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.212538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.212717] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2 with status ACTIVE [ 1179.212949] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.213124] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.213223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.213546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.213709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.213963] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.214141] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.214231] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.214485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.214606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.214918] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.215064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.215164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.215342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.215433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.215521] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2 is going to be updated. [ 1179.220441] env[65161]: INFO networking_nsxv3.common.synchronization [None req-8b511996-539a-447e-b3f9-f9038c919994 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_rules [ 1179.220966] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_rules [ 1179.221342] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a3857b-abc1-464f-9b15-c97784bb1930 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.221555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.240820] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.241448] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.241545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.241874] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.242057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.242317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e18b8a7-ac1e-4eb0-8dd5-2afbc3b23aa2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.647043] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.647043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.647043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.647488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.647488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.647488] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a3857b-abc1-464f-9b15-c97784bb1930 already deleted. [ 1179.647590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.647657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.647823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.647909] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.181130] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.181273] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.181344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.181840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.181840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.181840] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a3857b-abc1-464f-9b15-c97784bb1930 already deleted. [ 1180.182187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.596319] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1180.596558] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.596689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.596937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.597153] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.597288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.597353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.597520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.597611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.597720] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.631531] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: SUCCESS [ 1180.631911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.784057] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: SUCCESS [ 1180.784461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.941493] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1180.941712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.941910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.942214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.942420] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.942538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.942631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.942789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.942887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.942944] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.943053] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.100422] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.445333] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.445647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.445647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.445866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.445995] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.446111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.446229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.446340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.446430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.446538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.446658] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.446785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.446896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.446983] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.447156] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.447266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.447266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.447427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.447562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.447562] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.447693] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.602679] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.949891] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ad3588-f61e-418d-9a8e-c65add44c1be: rpc.has_security_group_logging(os_id): False [ 1181.966801] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.967017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.967086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.967290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.967378] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.967602] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.967699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.967762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.967912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.967990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.968206] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.968322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.968393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.968534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.968610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.968785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.968878] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.968939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.969089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.969163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.969247] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1182.030839] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.031028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.031071] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.031397] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.031594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.046920] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1182.104971] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.105209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.105209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.105580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.105704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.105978] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1182.137881] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.138081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.138182] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.138416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.138564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.149381] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1183.578769] env[65161]: INFO networking_nsxv3.common.synchronization [req-b111467d-5dfd-4202-9fb9-ba1f76ef0ffc req-8d071b73-f35d-4072-b72b-c1d325aeda5a tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1183.579358] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGHEST for action security_group_members [ 1183.579632] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.579751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.583018] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.583410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.584144] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.584296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.584387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.584768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.584886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.584947] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.060249] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1184.060467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.091115] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.091115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.091115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.091115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.091115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.091115] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.091373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.091373] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.091438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.091524] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.091610] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 is going to be updated. [ 1184.119944] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.120088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.120088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.120305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.120446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.129097] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: IN_PROGRESS for 2s [ 1184.158054] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1184.158054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.158054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.158054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.158054] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.158537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.158537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.158537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.158537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.158537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.158686] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.660558] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.660974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.660974] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.661100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.661650] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.661650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.661650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.661650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.661650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.661650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.661939] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.661988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.662063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.662192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.662332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.662438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.662491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.662634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.662714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.662789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.662880] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.903273] env[65161]: INFO networking_nsxv3.common.synchronization [req-a61c9ad8-f533-456d-94a4-8e630df4a0ed req-4bc25dd5-a844-4a3b-bcb1-c3f1e3a753d5 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_members [ 1184.905740] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_members [ 1184.905740] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a3857b-abc1-464f-9b15-c97784bb1930 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.905740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.905740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.905740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.905740] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.905740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.905740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.905740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.905740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.905740] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.165312] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7caaaa94-1988-4a64-baf8-2e9ad4c3a553: rpc.has_security_group_logging(os_id): False [ 1185.185322] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.185322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.185322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.185322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.185322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.185322] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.185322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.185322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.185322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.185322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.186028] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.186028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.186028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.186028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.186028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.186235] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.186292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.186358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.186498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.186572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.186659] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1185.201532] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-64 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.201748] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.202627] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.202627] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.202627] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.202874] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.203054] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.203459] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.203711] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.203981] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.204135] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.204274] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.204417] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.204557] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.204670] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.204806] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.227410] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.227603] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1185.227817] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.227880] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-64" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.228239] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-d8e3aea3-f422-4fda-8298-6d7dce44ecab taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.228416] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-d8e3aea3-f422-4fda-8298-6d7dce44ecab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.228537] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-d8e3aea3-f422-4fda-8298-6d7dce44ecab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.228879] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-d8e3aea3-f422-4fda-8298-6d7dce44ecab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.229033] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e3aea3-f422-4fda-8298-6d7dce44ecab',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.258769] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.259084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.259149] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.259761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.259761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.272846] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1185.407384] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.407601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.407601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.407818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.407905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.408114] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.408206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.408269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.408415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.408488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.408573] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a3857b-abc1-464f-9b15-c97784bb1930 already deleted. [ 1185.408653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.734326] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.734326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.734326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.734326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.734326] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.734326] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port d8e3aea3-f422-4fda-8298-6d7dce44ecab not found, creating... [ 1185.734326] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.734952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.734952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.734952] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.735257] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.736079] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.736450] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.736631] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.736921] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.737191] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.737384] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: d8e3aea3-f422-4fda-8298-6d7dce44ecab is going to be created. [ 1185.758725] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.759039] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.759227] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.759562] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.759958] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.760402] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-d8e3aea3-f422-4fda-8298-6d7dce44ecab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.139460] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 in Status: SUCCESS [ 1186.140679] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 deletion is rescheduled due to dependency. [ 1186.140679] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.476660] env[65161]: INFO networking_nsxv3.common.synchronization [req-a61c9ad8-f533-456d-94a4-8e630df4a0ed req-8c261599-7cba-4b1a-84ac-c4fecc6b52e3 service nova] Enqueued Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_rules [ 1186.477041] env[65161]: INFO networking_nsxv3.common.synchronization [req-a61c9ad8-f533-456d-94a4-8e630df4a0ed req-8c261599-7cba-4b1a-84ac-c4fecc6b52e3 service nova] Enqueued Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_members [ 1186.477041] env[65161]: INFO networking_nsxv3.common.synchronization [req-a61c9ad8-f533-456d-94a4-8e630df4a0ed req-8c261599-7cba-4b1a-84ac-c4fecc6b52e3 service nova] Enqueued Resource ID: d8e3aea3-f422-4fda-8298-6d7dce44ecab with Priority: HIGHEST for action port [ 1186.477537] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_rules [ 1186.477799] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_members [ 1186.477799] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e3aea3-f422-4fda-8298-6d7dce44ecab with Priority: HIGHEST for action port [ 1186.480059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a3857b-abc1-464f-9b15-c97784bb1930 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.480431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.480431] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.480502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.480592] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.481437] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a3857b-abc1-464f-9b15-c97784bb1930 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.481576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.481649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.481774] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.481918] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.482014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.482073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.482230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.482312] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.482401] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.483995] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8e3aea3-f422-4fda-8298-6d7dce44ecab taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.483995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8e3aea3-f422-4fda-8298-6d7dce44ecab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.484705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8e3aea3-f422-4fda-8298-6d7dce44ecab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.484820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8e3aea3-f422-4fda-8298-6d7dce44ecab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.484896] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e3aea3-f422-4fda-8298-6d7dce44ecab',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.986926] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a3857b-abc1-464f-9b15-c97784bb1930 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.987404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.987404] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.988188] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8e3aea3-f422-4fda-8298-6d7dce44ecab with status ACTIVE [ 1186.988351] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.988461] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.988527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.988731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.988819] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.988991] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.989100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.989164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.989344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.989426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.989610] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.989708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.989749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.989892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.989966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.990062] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8e3aea3-f422-4fda-8298-6d7dce44ecab is going to be updated. [ 1187.011230] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.011507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.011507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.011617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.011755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.011935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8e3aea3-f422-4fda-8298-6d7dce44ecab" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.287769] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1187.288022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.492748] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.995118] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.996223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.996223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.996223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.996223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.996223] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a3857b-abc1-464f-9b15-c97784bb1930 is going to be created. [ 1188.019420] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.019576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.019642] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.019888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.020130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.027782] env[65161]: INFO networking_nsxv3.common.synchronization [None req-094e908b-f2d2-437e-b067-0ab6398165ea tempest-AttachInterfacesTestJSON-708297032 tempest-AttachInterfacesTestJSON-708297032-project-member] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1188.028316] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGHEST for action security_group_members [ 1188.028625] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.028746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.029503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.029503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.029503] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.029503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.029503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.030190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.030190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.030190] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.031256] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a3857b-abc1-464f-9b15-c97784bb1930 in Status: UNINITIALIZED for 2s [ 1188.383024] env[65161]: INFO networking_nsxv3.common.synchronization [req-85d0fa09-76df-4e2e-be79-4d505d321b26 req-88072e0d-038c-4427-b4b6-24d28aa8fbfa tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1188.383603] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1188.384087] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.384157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.384206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.384393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.384560] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.384704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.384826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.385090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.385238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.385413] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.532837] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.532837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.532837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.533108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.533211] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.533489] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.533556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.533611] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.533777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.533963] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.534106] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be updated. [ 1188.570964] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.571235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.571297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.571528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.571638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.584161] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: IN_PROGRESS for 2s [ 1188.889139] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.889587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.889691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.890328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.890328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.890328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.890486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.890486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.891322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.891322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.891322] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1188.918966] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.919177] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.919225] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.919410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.919546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.928469] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1190.041912] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a3857b-abc1-464f-9b15-c97784bb1930 in Status: SUCCESS [ 1190.041912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.042429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.042634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.042812] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.042932] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.042995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.043155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.043234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.043314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.043414] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.547522] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.595231] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda in Status: SUCCESS [ 1190.595434] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda deletion is rescheduled due to dependency. [ 1190.595588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.938947] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1190.939023] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1190.939114] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.050104] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6a3857b-abc1-464f-9b15-c97784bb1930: rpc.has_security_group_logging(os_id): False [ 1191.077785] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.077928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.078014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.078232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.078325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.078571] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.078703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.078754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.078881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.078959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.079057] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a3857b-abc1-464f-9b15-c97784bb1930 is going to be created. [ 1191.162122] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.162226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.162281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.162492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.162675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.173553] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a3857b-abc1-464f-9b15-c97784bb1930 in Status: IN_PROGRESS for 2s [ 1192.484121] env[65161]: INFO networking_nsxv3.common.synchronization [req-29a85d6f-2af6-47b6-bacf-a4549e2b03a9 req-60940f87-0cdc-4c13-86e0-9f3f28704df6 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1192.484812] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1192.485200] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.485377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.485490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.485741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.486011] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.486159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.486271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.486478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.486609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.486885] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.902796] env[65161]: INFO networking_nsxv3.common.synchronization [req-1ff08030-ee7a-45d5-97c4-ca074a0d910e req-33f9827f-9ba1-48f2-bd74-707aeb4f6cd7 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: ed94efd9-d268-4923-b435-d1e919bd92ce with Priority: HIGHEST for action security_group_members [ 1192.906346] env[65161]: INFO networking_nsxv3.common.synchronization [req-1ff08030-ee7a-45d5-97c4-ca074a0d910e req-33f9827f-9ba1-48f2-bd74-707aeb4f6cd7 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1192.906860] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed94efd9-d268-4923-b435-d1e919bd92ce with Priority: HIGHEST for action security_group_members [ 1192.907112] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1192.907797] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed94efd9-d268-4923-b435-d1e919bd92ce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.907797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.907797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.907959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.908104] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.908192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.908248] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.908387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.908470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.908563] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.909453] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.909615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.909615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.909884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.909994] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.909994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.910195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.910195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.910349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.910349] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.954211] env[65161]: INFO networking_nsxv3.common.synchronization [req-1ff08030-ee7a-45d5-97c4-ca074a0d910e req-33f9827f-9ba1-48f2-bd74-707aeb4f6cd7 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_rules [ 1192.957025] env[65161]: INFO networking_nsxv3.common.synchronization [req-1ff08030-ee7a-45d5-97c4-ca074a0d910e req-33f9827f-9ba1-48f2-bd74-707aeb4f6cd7 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1192.957025] env[65161]: INFO networking_nsxv3.common.synchronization [req-1ff08030-ee7a-45d5-97c4-ca074a0d910e req-33f9827f-9ba1-48f2-bd74-707aeb4f6cd7 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: ed94efd9-d268-4923-b435-d1e919bd92ce with Priority: HIGHEST for action security_group_rules [ 1192.957025] env[65161]: INFO networking_nsxv3.common.synchronization [req-1ff08030-ee7a-45d5-97c4-ca074a0d910e req-33f9827f-9ba1-48f2-bd74-707aeb4f6cd7 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: ed94efd9-d268-4923-b435-d1e919bd92ce with Priority: HIGHEST for action security_group_members [ 1192.957025] env[65161]: INFO networking_nsxv3.common.synchronization [req-1ff08030-ee7a-45d5-97c4-ca074a0d910e req-33f9827f-9ba1-48f2-bd74-707aeb4f6cd7 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with Priority: HIGHEST for action port [ 1192.957025] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_rules [ 1192.957025] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed94efd9-d268-4923-b435-d1e919bd92ce with Priority: HIGHEST for action security_group_rules [ 1192.960046] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with Priority: HIGHEST for action port [ 1192.960046] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1192.960046] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed94efd9-d268-4923-b435-d1e919bd92ce with Priority: HIGHEST for action security_group_members [ 1192.960046] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.960046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.960046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.960370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.960651] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.961871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed94efd9-d268-4923-b435-d1e919bd92ce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.961871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.961871] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.962730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.962730] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.963502] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.963502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.963836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.964103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.964234] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a822607e-3f2e-4e33-a9fb-94e8ea93ffa3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.965344] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.965344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.965344] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed94efd9-d268-4923-b435-d1e919bd92ce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.965504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.993328] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.188251] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a3857b-abc1-464f-9b15-c97784bb1930 in Status: SUCCESS [ 1193.188627] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.331379] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1652170-a44c-4d67-96e2-ac26949bd5ff req-b33a2261-3635-4ff4-b91b-55a701394880 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: ed94efd9-d268-4923-b435-d1e919bd92ce with Priority: HIGHEST for action security_group_members [ 1193.331675] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1652170-a44c-4d67-96e2-ac26949bd5ff req-b33a2261-3635-4ff4-b91b-55a701394880 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1193.332265] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed94efd9-d268-4923-b435-d1e919bd92ce with Priority: HIGHEST for action security_group_members [ 1193.332747] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1193.333283] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed94efd9-d268-4923-b435-d1e919bd92ce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.333390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.333617] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.333695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.382089] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1652170-a44c-4d67-96e2-ac26949bd5ff req-b33a2261-3635-4ff4-b91b-55a701394880 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_rules [ 1193.382198] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1652170-a44c-4d67-96e2-ac26949bd5ff req-b33a2261-3635-4ff4-b91b-55a701394880 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1193.382343] env[65161]: INFO networking_nsxv3.common.synchronization [req-f1652170-a44c-4d67-96e2-ac26949bd5ff req-b33a2261-3635-4ff4-b91b-55a701394880 tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with Priority: HIGHEST for action port [ 1193.382891] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_rules [ 1193.383043] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1193.383247] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with Priority: HIGHEST for action port [ 1193.383421] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.383521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.383760] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.383857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.384261] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.384261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.411862] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.414242] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.416021] env[65161]: INFO networking_nsxv3.common.synchronization [None req-c7c02013-d933-48be-b3f5-e7939532c12a None None] Enqueued Resource ID: 7273c8a0-166d-4962-a0b3-2089e1c28c18 with Priority: HIGHEST for action port [ 1193.416742] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7273c8a0-166d-4962-a0b3-2089e1c28c18 with Priority: HIGHEST for action port [ 1193.417164] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-7273c8a0-166d-4962-a0b3-2089e1c28c18 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.417296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7273c8a0-166d-4962-a0b3-2089e1c28c18" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.417369] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7273c8a0-166d-4962-a0b3-2089e1c28c18" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.417672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7273c8a0-166d-4962-a0b3-2089e1c28c18" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.417753] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7273c8a0-166d-4962-a0b3-2089e1c28c18',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.467107] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.467346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.467685] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with status ACTIVE [ 1193.467842] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.467966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.468062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.468306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.468413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.468636] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.468790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.468895] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.469060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.469153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.469402] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.469643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.469643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.469776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.469856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.469946] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 is going to be updated. [ 1193.471251] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed94efd9-d268-4923-b435-d1e919bd92ce taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.471385] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.493169] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.493463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.493554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.493873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.494591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.494591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.494712] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.495450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.495657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.495740] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a822607e-3f2e-4e33-a9fb-94e8ea93ffa3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.917043] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.918051] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.920449] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7273c8a0-166d-4962-a0b3-2089e1c28c18 [ 1193.920449] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.920449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.920449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.924170] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.924288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.924400] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7273c8a0-166d-4962-a0b3-2089e1c28c18 already deleted. [ 1193.924554] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7273c8a0-166d-4962-a0b3-2089e1c28c18" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.998053] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.998246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.998319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.999035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.999035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.999035] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1193.999904] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 with status ACTIVE [ 1194.000101] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.000208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.000271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.000425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.000576] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.000652] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.000742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.000802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.000947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.001037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.001307] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.001307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.001396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.001485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.001555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.001638] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a822607e-3f2e-4e33-a9fb-94e8ea93ffa3 is going to be updated. [ 1194.022444] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.022444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.022444] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.022789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.022789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.022881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a822607e-3f2e-4e33-a9fb-94e8ea93ffa3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.030848] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.030978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.031061] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.031263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.031436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.040972] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1194.425836] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.426058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.426058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.426345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.426463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.426580] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be updated. [ 1194.427971] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.428111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.428150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.428317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.428398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.428800] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed94efd9-d268-4923-b435-d1e919bd92ce is going to be created. [ 1194.455762] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.455762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.455762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.455762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.455762] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.460227] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.460377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.460434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.460585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.460755] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.469321] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed94efd9-d268-4923-b435-d1e919bd92ce in Status: UNINITIALIZED for 2s [ 1194.469992] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: IN_PROGRESS for 2s [ 1195.365527] env[65161]: INFO networking_nsxv3.common.synchronization [req-1fb8df32-603c-45eb-bbd4-fc6818e202b2 req-21e6ca33-a4e8-426a-9690-da348e7a7efb tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 1195.365527] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 1195.365527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.365527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.365527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.365527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.365527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.365527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.365527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.365527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.365527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.365527] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.789086] env[65161]: INFO networking_nsxv3.common.synchronization [None req-4a44fca9-1e74-4680-b1c6-486b01a8785e None None] Enqueued Resource ID: 18a3a2d1-94dd-423f-ab09-18cb93f3dfce with Priority: HIGHEST for action port [ 1195.789086] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18a3a2d1-94dd-423f-ab09-18cb93f3dfce with Priority: HIGHEST for action port [ 1195.789086] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-18a3a2d1-94dd-423f-ab09-18cb93f3dfce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.789086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18a3a2d1-94dd-423f-ab09-18cb93f3dfce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.789086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18a3a2d1-94dd-423f-ab09-18cb93f3dfce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.790647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18a3a2d1-94dd-423f-ab09-18cb93f3dfce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.790647] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a3a2d1-94dd-423f-ab09-18cb93f3dfce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.820322] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.820322] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.820722] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.821716] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.822594] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.822594] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.822594] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.822791] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.822791] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.823080] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1195.823238] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.823378] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.823506] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.823651] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1195.823788] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.824015] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.849511] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.849511] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1195.849511] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.849511] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-830" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.849807] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-e86fafaf-2771-41a7-8683-544a6c91e1b0 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.849941] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-e86fafaf-2771-41a7-8683-544a6c91e1b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.850075] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-e86fafaf-2771-41a7-8683-544a6c91e1b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.850430] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-e86fafaf-2771-41a7-8683-544a6c91e1b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.850566] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e86fafaf-2771-41a7-8683-544a6c91e1b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.867680] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.052588] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1196.052812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.294948] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18a3a2d1-94dd-423f-ab09-18cb93f3dfce [ 1196.295227] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.295344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.295414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.295681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.295884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.296171] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18a3a2d1-94dd-423f-ab09-18cb93f3dfce already deleted. [ 1196.296433] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18a3a2d1-94dd-423f-ab09-18cb93f3dfce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.356639] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.357099] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.357322] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.357698] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.357904] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.358158] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port e86fafaf-2771-41a7-8683-544a6c91e1b0 not found, creating... [ 1196.358536] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.358755] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.358937] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.359402] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.359654] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.360102] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.360394] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.360589] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.360920] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.361175] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.361404] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: e86fafaf-2771-41a7-8683-544a6c91e1b0 is going to be created. [ 1196.369567] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.388472] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.388689] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.388909] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.389401] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.389786] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.390180] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-e86fafaf-2771-41a7-8683-544a6c91e1b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.487889] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed94efd9-d268-4923-b435-d1e919bd92ce in Status: SUCCESS [ 1196.487889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.487889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.487889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.488347] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.488347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.488347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.488536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.488645] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.488760] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.490429] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: SUCCESS [ 1196.490615] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.490788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.490973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.491162] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.491282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.491338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.492264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.492264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.492264] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.872058] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.872294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.872390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.873879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.873879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.873879] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be updated. [ 1196.908842] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.909064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.909064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.910484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.910484] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.919664] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: IN_PROGRESS for 2s [ 1196.996675] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.997162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.997162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.997338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.997477] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.998544] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.998544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.998544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.998544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.998544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.998544] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed94efd9-d268-4923-b435-d1e919bd92ce is going to be deleted. [ 1196.999988] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.033767] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.034862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.034862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.034862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.034862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.034862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.034862] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.035335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.035335] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.035422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.035422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.035823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.035823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.035928] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.109787] env[65161]: INFO networking_nsxv3.common.synchronization [req-1fb8df32-603c-45eb-bbd4-fc6818e202b2 req-09166ba0-5d97-41f1-89af-d1f73d872b16 service nova] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_rules [ 1197.109974] env[65161]: INFO networking_nsxv3.common.synchronization [req-1fb8df32-603c-45eb-bbd4-fc6818e202b2 req-09166ba0-5d97-41f1-89af-d1f73d872b16 service nova] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 1197.110131] env[65161]: INFO networking_nsxv3.common.synchronization [req-1fb8df32-603c-45eb-bbd4-fc6818e202b2 req-09166ba0-5d97-41f1-89af-d1f73d872b16 service nova] Enqueued Resource ID: e86fafaf-2771-41a7-8683-544a6c91e1b0 with Priority: HIGHEST for action port [ 1197.110787] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_rules [ 1197.110833] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 1197.110925] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e86fafaf-2771-41a7-8683-544a6c91e1b0 with Priority: HIGHEST for action port [ 1197.111233] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.111371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.111426] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.111610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.111730] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.113140] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.113140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.113284] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e86fafaf-2771-41a7-8683-544a6c91e1b0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.113390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e86fafaf-2771-41a7-8683-544a6c91e1b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.113455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e86fafaf-2771-41a7-8683-544a6c91e1b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.113682] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e86fafaf-2771-41a7-8683-544a6c91e1b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.113734] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e86fafaf-2771-41a7-8683-544a6c91e1b0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.505661] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.538696] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.539133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.539133] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.539330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.539330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.539556] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.539712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.539778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.539951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.540042] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.540129] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed94efd9-d268-4923-b435-d1e919bd92ce already deleted. [ 1197.540206] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.540416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.540728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.540955] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.541110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.541268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.541418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.541540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.541751] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.615324] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.615475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.615650] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e86fafaf-2771-41a7-8683-544a6c91e1b0 with status ACTIVE [ 1197.615941] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.615941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.616136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.616587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.616836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.617091] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.617283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.617430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.617625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.617712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.617906] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.618107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.618284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.618458] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.618545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.618637] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e86fafaf-2771-41a7-8683-544a6c91e1b0 is going to be updated. [ 1197.642134] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.642134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.642134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.642418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.642662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.643315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e86fafaf-2771-41a7-8683-544a6c91e1b0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.006021] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.006499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.006499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.006716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.006843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.006976] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be updated. [ 1198.040090] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.040242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.040352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.040595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.040772] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.043752] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.043939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.044160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.044233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.044328] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.044543] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.044664] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.044723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.044845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.044921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.045012] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed94efd9-d268-4923-b435-d1e919bd92ce already deleted. [ 1198.045109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.045192] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.051643] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: IN_PROGRESS for 2s [ 1198.547517] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed94efd9-d268-4923-b435-d1e919bd92ce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.930856] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 1198.931106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.931269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.931490] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.931680] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.931796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.931864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.932024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.932110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.932212] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.944895] env[65161]: INFO networking_nsxv3.common.synchronization [req-a7fcb805-3bba-4f01-838c-7c7a5681ccce req-4d404691-6c54-4003-a3ae-dcd1ef3dc05c tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1198.945753] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1198.946171] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.946325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.946399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.946585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.946759] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.946860] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.947631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.947631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.947631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.947631] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.049318] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed94efd9-d268-4923-b435-d1e919bd92ce: rpc.has_security_group_logging(os_id): False [ 1199.073521] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.073725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.073725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.073881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.073995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.074213] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.074321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.074395] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.074568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.074900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.074900] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed94efd9-d268-4923-b435-d1e919bd92ce is going to be created. [ 1199.097765] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ed94efd9-d268-4923-b435-d1e919bd92ce], does not exist path=[/infra/domains/default/groups/ed94efd9-d268-4923-b435-d1e919bd92ce]."\n}' [ 1199.097919] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed94efd9-d268-4923-b435-d1e919bd92ce failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ed94efd9-d268-4923-b435-d1e919bd92ce [ 1199.098120] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1199.139724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.139996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.139996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.140217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.141663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.141897] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.142025] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.142094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.142260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.142341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.142513] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.142607] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.142668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.142807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.142880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.142965] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed94efd9-d268-4923-b435-d1e919bd92ce is going to be created. [ 1199.160293] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ed94efd9-d268-4923-b435-d1e919bd92ce], does not exist path=[/infra/domains/default/groups/ed94efd9-d268-4923-b435-d1e919bd92ce]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ed94efd9-d268-4923-b435-d1e919bd92ce [ 1199.160528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed94efd9-d268-4923-b435-d1e919bd92ce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.160670] env[65161]: Traceback (most recent call last): [ 1199.160721] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1199.160721] env[65161]: return func(*args, **kwargs) [ 1199.160721] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1199.160721] env[65161]: res.raise_for_status() [ 1199.160721] env[65161]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1199.160721] env[65161]: raise HTTPError(http_error_msg, response=self) [ 1199.160721] env[65161]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ed94efd9-d268-4923-b435-d1e919bd92ce [ 1199.160721] env[65161]: During handling of the above exception, another exception occurred: [ 1199.160721] env[65161]: Traceback (most recent call last): [ 1199.160721] env[65161]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1199.160721] env[65161]: listener.cb(fileno) [ 1199.160721] env[65161]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1199.160721] env[65161]: result = function(*args, **kwargs) [ 1199.160721] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1199.160721] env[65161]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1199.160721] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1199.160721] env[65161]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1199.160721] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1199.160721] env[65161]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1199.160721] env[65161]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1199.160721] env[65161]: res.raise_for_status() [ 1199.161431] env[65161]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1199.161431] env[65161]: raise HTTPError(http_error_msg, response=self) [ 1199.161431] env[65161]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ed94efd9-d268-4923-b435-d1e919bd92ce [ 1199.161431] env[65161]: Removing descriptor: 57 [ 1199.295767] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.295767] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.295993] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.296230] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.296465] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.296710] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.296833] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.297081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.297666] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.297897] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.298047] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.298166] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.298282] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.298408] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.298511] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.298645] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.319503] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.319679] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.319824] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.320055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-121" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.320496] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-708e37c1-fd31-4b11-a8ce-47925adac9e8 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.320675] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-708e37c1-fd31-4b11-a8ce-47925adac9e8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.320793] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-708e37c1-fd31-4b11-a8ce-47925adac9e8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.321135] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-708e37c1-fd31-4b11-a8ce-47925adac9e8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.321320] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('708e37c1-fd31-4b11-a8ce-47925adac9e8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.435829] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.450752] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.452527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.452527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.452527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.473986] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.474332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.474464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.474532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.474735] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.474820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.474910] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1199.503958] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.504181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.504181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.504453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.504821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.514179] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1199.824273] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.824747] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.824937] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.825333] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.825577] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.825881] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port 708e37c1-fd31-4b11-a8ce-47925adac9e8 not found, creating... [ 1199.826308] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.826583] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.826797] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.827131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.827368] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.827760] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.828058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.828259] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.828535] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.828737] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.828947] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: 708e37c1-fd31-4b11-a8ce-47925adac9e8 is going to be created. [ 1199.851674] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.851875] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.851988] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.852365] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.852636] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.852922] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-708e37c1-fd31-4b11-a8ce-47925adac9e8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.937894] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.062858] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: SUCCESS [ 1200.063095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.063280] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.063529] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.063795] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.064186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.064338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.064494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.064552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.064635] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.182440] env[65161]: INFO networking_nsxv3.common.synchronization [req-665a60ae-5bf4-42a8-9642-e6c02fe34597 req-76a4e2a9-b2b8-47ac-bde5-0da4f0ebc101 tempest-ServersTestJSON-1600597058 tempest-ServersTestJSON-1600597058-project-member] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1200.183410] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGHEST for action security_group_members [ 1200.183775] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.184401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.184494] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.186293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.186293] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.186293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.186293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.186293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.186293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.186293] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.440672] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.440841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.440911] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.441157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.441370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.441499] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be updated. [ 1200.474241] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.474241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.474241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.474445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.474445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.484721] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: IN_PROGRESS for 2s [ 1200.566641] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.585173] env[65161]: INFO networking_nsxv3.common.synchronization [req-a7fcb805-3bba-4f01-838c-7c7a5681ccce req-d1b89cd1-3e33-4e3e-92b5-d2628ed40e32 service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1200.585282] env[65161]: INFO networking_nsxv3.common.synchronization [req-a7fcb805-3bba-4f01-838c-7c7a5681ccce req-d1b89cd1-3e33-4e3e-92b5-d2628ed40e32 service nova] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1200.585356] env[65161]: INFO networking_nsxv3.common.synchronization [req-a7fcb805-3bba-4f01-838c-7c7a5681ccce req-d1b89cd1-3e33-4e3e-92b5-d2628ed40e32 service nova] Enqueued Resource ID: 708e37c1-fd31-4b11-a8ce-47925adac9e8 with Priority: HIGHEST for action port [ 1200.586041] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_rules [ 1200.586204] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1200.586305] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 708e37c1-fd31-4b11-a8ce-47925adac9e8 with Priority: HIGHEST for action port [ 1200.586941] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.587342] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.587430] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.587635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.587717] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.588589] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.589578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.589578] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-708e37c1-fd31-4b11-a8ce-47925adac9e8 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.589578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-708e37c1-fd31-4b11-a8ce-47925adac9e8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.589578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-708e37c1-fd31-4b11-a8ce-47925adac9e8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.589578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-708e37c1-fd31-4b11-a8ce-47925adac9e8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.589578] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('708e37c1-fd31-4b11-a8ce-47925adac9e8',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.688687] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.688847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.688912] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.689148] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.712864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.713094] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.713219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.713287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.713613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.713613] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.713748] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be updated. [ 1200.742450] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.742450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.742450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.742697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.742844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.753611] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: IN_PROGRESS for 2s [ 1200.834651] env[65161]: INFO networking_nsxv3.common.synchronization [req-da62725b-5c9f-4add-beae-d32daf3c2bb8 req-0a1206f8-7431-4412-9a00-a8a96803ff2b tempest-ServerRescueTestJSONUnderV235-1411643871 tempest-ServerRescueTestJSONUnderV235-1411643871-project-member] Enqueued Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1200.835142] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 with Priority: HIGHEST for action security_group_members [ 1200.835492] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.835650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.069254] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.092289] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.092289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.092289] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 708e37c1-fd31-4b11-a8ce-47925adac9e8 with status ACTIVE [ 1201.092289] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.092727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.092727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.092842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.092991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.093426] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.093536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.093536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.093748] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.093857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.094074] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.094178] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.094241] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.094541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.094541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.094670] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 708e37c1-fd31-4b11-a8ce-47925adac9e8 is going to be updated. [ 1201.133295] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.133564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.133564] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.133729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.133928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.134128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-708e37c1-fd31-4b11-a8ce-47925adac9e8" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.261195] env[65161]: INFO networking_nsxv3.common.synchronization [req-8142626b-921a-444c-950a-9295e8b494dd req-0fc43d6b-33b1-4357-b66c-42fdabba3a71 tempest-InstanceActionsV221TestJSON-1743559162 tempest-InstanceActionsV221TestJSON-1743559162-project-member] Enqueued Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGHEST for action security_group_members [ 1201.261775] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGHEST for action security_group_members [ 1201.262099] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-a004fc9f-8188-4952-8c7f-947ab65480c2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.262235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.262737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.262737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.262737] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.262918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.262918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.263325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.263325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.263325] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.526740] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1201.527064] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1201.527064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.527365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.527614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.527858] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.528156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.528156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.528360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.528360] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.528539] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.571996] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.572199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.572266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.572491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.572584] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.572723] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be updated. [ 1201.603953] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.604190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.604190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.604380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.604548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.615696] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: IN_PROGRESS for 2s [ 1201.636674] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.636944] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-130" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.637131] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-130" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.637491] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-130" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.637784] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.637993] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.638153] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.638373] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.638516] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.638729] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.638841] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.638949] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.639078] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.639247] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.639357] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.639490] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.659819] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.659987] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1201.660052] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.660205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-130" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.660608] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-8166c34c-9072-4a22-a3cd-1087ce072a5c taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.660761] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-8166c34c-9072-4a22-a3cd-1087ce072a5c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.660887] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-8166c34c-9072-4a22-a3cd-1087ce072a5c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.661194] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-8166c34c-9072-4a22-a3cd-1087ce072a5c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.661345] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8166c34c-9072-4a22-a3cd-1087ce072a5c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.765804] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.766088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.766194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.766450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.766589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.766877] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.767046] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.767168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.767394] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.767498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.767613] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a004fc9f-8188-4952-8c7f-947ab65480c2 already deleted. [ 1201.767723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.030891] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.163913] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.164180] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.164236] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.164492] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.164641] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.164795] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 8166c34c-9072-4a22-a3cd-1087ce072a5c not found, creating... [ 1202.165076] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.165233] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.165348] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.165561] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.165693] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.165965] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.166184] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.166307] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.166858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.166858] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.166858] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 8166c34c-9072-4a22-a3cd-1087ce072a5c is going to be created. [ 1202.186862] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.187108] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.187244] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.187541] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.187785] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.188041] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-8166c34c-9072-4a22-a3cd-1087ce072a5c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.496121] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 1202.496268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.496416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.496639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.496831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.496964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.497074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.497279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.497358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.497446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.497540] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.533188] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.764818] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 in Status: SUCCESS [ 1202.765008] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 deletion is rescheduled due to dependency. [ 1202.765155] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.910231] env[65161]: INFO networking_nsxv3.common.synchronization [req-8142626b-921a-444c-950a-9295e8b494dd req-2fc26179-e8ee-4191-ae9b-30ab63d8ab28 service nova] Enqueued Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGHEST for action security_group_rules [ 1202.910421] env[65161]: INFO networking_nsxv3.common.synchronization [req-8142626b-921a-444c-950a-9295e8b494dd req-2fc26179-e8ee-4191-ae9b-30ab63d8ab28 service nova] Enqueued Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGHEST for action security_group_members [ 1202.910558] env[65161]: INFO networking_nsxv3.common.synchronization [req-8142626b-921a-444c-950a-9295e8b494dd req-2fc26179-e8ee-4191-ae9b-30ab63d8ab28 service nova] Enqueued Resource ID: 8166c34c-9072-4a22-a3cd-1087ce072a5c with Priority: HIGHEST for action port [ 1202.911332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGHEST for action security_group_rules [ 1202.911332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGHEST for action security_group_members [ 1202.911332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8166c34c-9072-4a22-a3cd-1087ce072a5c with Priority: HIGHEST for action port [ 1202.911593] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a004fc9f-8188-4952-8c7f-947ab65480c2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.911660] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.911730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.911982] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.912193] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.913488] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-a004fc9f-8188-4952-8c7f-947ab65480c2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.913488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.913608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.913768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.913947] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.914083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.914176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.914349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.914465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.914591] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.915360] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-8166c34c-9072-4a22-a3cd-1087ce072a5c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.915505] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8166c34c-9072-4a22-a3cd-1087ce072a5c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.915599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8166c34c-9072-4a22-a3cd-1087ce072a5c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.916105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8166c34c-9072-4a22-a3cd-1087ce072a5c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.916105] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8166c34c-9072-4a22-a3cd-1087ce072a5c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.002262] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.035915] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.035915] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.036327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.036327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.036327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.036526] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1203.065332] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.065513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.065559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.065772] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.065918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.075895] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1203.419423] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-a004fc9f-8188-4952-8c7f-947ab65480c2 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.419423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.419423] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.421494] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8166c34c-9072-4a22-a3cd-1087ce072a5c with status ACTIVE [ 1203.421679] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.421920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.421920] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.422083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.422909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.422909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.422909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.422909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.422909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.422909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.422909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.423297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.423297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.423297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.423297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.423297] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8166c34c-9072-4a22-a3cd-1087ce072a5c is going to be updated. [ 1203.444577] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.444740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.444811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.445026] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.445166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.445322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8166c34c-9072-4a22-a3cd-1087ce072a5c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.506900] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d21165f7-b2bc-43ce-8cb7-61f74b45df43: rpc.has_security_group_logging(os_id): False [ 1203.523863] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.524099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.524192] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.524417] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.547209] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.547539] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.547662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.547731] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.547934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.548034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.548130] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be updated. [ 1203.621381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.621381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.621381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.621381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.621381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.632429] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: SUCCESS [ 1203.632614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.632659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.632884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.634034] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.634034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.634034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.634034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.634034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.634034] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.643187] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: IN_PROGRESS for 2s [ 1203.922257] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.141295] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.141751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.141751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.141751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.166808] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.167214] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.167367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.167464] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.167705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.167817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.167938] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be updated. [ 1204.203979] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.204162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.204947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.204947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.204947] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.214905] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: IN_PROGRESS for 2s [ 1204.423786] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.423943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.424024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.424366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.424471] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.424573] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a004fc9f-8188-4952-8c7f-947ab65480c2 is going to be created. [ 1204.452891] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.453066] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.453156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.453595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.453815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.464244] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a004fc9f-8188-4952-8c7f-947ab65480c2 in Status: UNINITIALIZED for 2s [ 1205.090533] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1205.091283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.092750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.092992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.093210] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.093335] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.093394] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.093553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.093637] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.093724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.093811] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.599069] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.599445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.599445] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.601546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.601627] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.601736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.601807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.601991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.602074] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.602466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.602958] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.602958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.602958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.603131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.604453] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.604453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.604453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.604453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.604453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.604453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.604453] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.656123] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 1205.656376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.108201] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ad3588-f61e-418d-9a8e-c65add44c1be: rpc.has_security_group_logging(os_id): False [ 1206.126535] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.126712] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.126764] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.126954] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.127045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.127272] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.127372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.127437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.128105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.128256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.128455] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.128555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.128638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.128829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.128867] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.129060] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.129163] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.129227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.129368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.129443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.129530] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1206.207961] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.209020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.209020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.209970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.210095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.223633] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: SUCCESS [ 1206.223816] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 deletion is rescheduled due to dependency. [ 1206.223930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.224171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.224400] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.224597] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.224727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.224783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.224942] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.225034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.225121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.225224] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.226191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.226429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.226835] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.226835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.226835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.226835] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.227120] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.227120] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.228557] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1206.475283] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a004fc9f-8188-4952-8c7f-947ab65480c2 in Status: SUCCESS [ 1206.475525] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.475702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.475934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.476175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.476364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.476493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.476668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.476714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.476788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.476890] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.729527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.729910] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.731430] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.731552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.731552] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.732675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.732675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.732675] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.732675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.732675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.732675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.732675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.732675] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be updated. [ 1206.763828] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.764267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.764351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.764747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.764919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.773753] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: IN_PROGRESS for 2s [ 1206.979994] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-a004fc9f-8188-4952-8c7f-947ab65480c2 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.980242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.980362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.980623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.980823] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.980929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.980993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.981195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.981302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.981413] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.981564] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-a004fc9f-8188-4952-8c7f-947ab65480c2 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.981684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.981750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.981894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.982079] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.982175] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.982234] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.982402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.982479] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.982577] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.982668] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.488456] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a004fc9f-8188-4952-8c7f-947ab65480c2: rpc.has_security_group_logging(os_id): False [ 1207.507448] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.507614] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.507678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.507864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.507990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.508186] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.508289] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.508344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.508500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.508577] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.508772] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.508881] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.508934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.509114] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.509183] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.509391] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.509492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.509546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.509724] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.509800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.509897] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a004fc9f-8188-4952-8c7f-947ab65480c2 is going to be created. [ 1207.572410] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.572745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.572745] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.572850] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.573159] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.586158] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a004fc9f-8188-4952-8c7f-947ab65480c2 in Status: IN_PROGRESS for 2s [ 1207.912239] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.912689] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1208.246514] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1208.247253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.784037] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: SUCCESS [ 1208.784256] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 deletion is rescheduled due to dependency. [ 1208.784375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.784537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.784752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.784943] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.785078] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.785145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.785305] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.785380] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.785469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.785704] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-65d0a279-7bb5-4571-b896-e799f6c734a9 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.785704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.785837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.785884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.786033] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.786135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.786187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.786317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.786390] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.786472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.786560] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.289350] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 65d0a279-7bb5-4571-b896-e799f6c734a9: rpc.has_security_group_logging(os_id): False [ 1209.310499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.310669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.310726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.310900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.310992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.311187] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.311288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.311347] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.311491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.311568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.311763] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.311857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.311916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.312063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.312142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.312312] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.312404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.312465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.312596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.312668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.312752] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be updated. [ 1209.380579] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.380579] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.380742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.380885] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.381052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.393576] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: IN_PROGRESS for 2s [ 1209.597684] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a004fc9f-8188-4952-8c7f-947ab65480c2 in Status: SUCCESS [ 1209.597906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.409027] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 in Status: SUCCESS [ 1211.409027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.409027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.409027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.409027] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('65d0a279-7bb5-4571-b896-e799f6c734a9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.929056] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.929271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.929271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.930052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.930052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.930052] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 65d0a279-7bb5-4571-b896-e799f6c734a9 is going to be deleted. [ 1211.981993] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.982184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.982228] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.982432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.982526] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.982653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-65d0a279-7bb5-4571-b896-e799f6c734a9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.913152] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1212.913502] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1215.641572] env[65161]: INFO networking_nsxv3.common.synchronization [req-2ecd736a-937f-4ce4-9776-1643cc007224 req-9cea9294-6aef-44ad-bb64-8d4649d1d8b7 tempest-InstanceActionsV221TestJSON-1743559162 tempest-InstanceActionsV221TestJSON-1743559162-project-member] Enqueued Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGHEST for action security_group_members [ 1215.642334] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGHEST for action security_group_members [ 1215.642812] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-a004fc9f-8188-4952-8c7f-947ab65480c2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.642883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.642970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.643277] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.644043] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.644043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.644244] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.644393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.644493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.644661] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.147271] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.147488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.147575] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.147839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.147957] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.148202] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.148330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.148442] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.148593] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.148684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.148788] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a004fc9f-8188-4952-8c7f-947ab65480c2 is going to be updated. [ 1216.184890] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.185101] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.185144] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.185338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.185492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.196379] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a004fc9f-8188-4952-8c7f-947ab65480c2 in Status: IN_PROGRESS for 2s [ 1218.207498] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a004fc9f-8188-4952-8c7f-947ab65480c2 in Status: IN_PROGRESS for 4s [ 1220.219802] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a004fc9f-8188-4952-8c7f-947ab65480c2 in Status: SUCCESS [ 1220.220181] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a004fc9f-8188-4952-8c7f-947ab65480c2 deletion is rescheduled due to dependency. [ 1220.220181] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.644905] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.645037] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1223.190622] env[65161]: INFO networking_nsxv3.common.synchronization [req-a1128ba2-3602-476d-9a22-f1e65ed5b2e5 req-fc6c117d-ecef-45f7-8320-05926dead453 tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1223.191303] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1223.191635] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.191767] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.191903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.192191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.192191] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.192317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.192441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.192693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.192693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.192952] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.695719] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.696132] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.696258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.696536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.720546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.720837] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.720961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.721044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.721340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.721340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.721458] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1223.747784] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.747922] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.747996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.748216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.748358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.756678] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1223.987464] env[65161]: INFO networking_nsxv3.common.synchronization [None req-98d71ed6-de38-45bc-883b-c5f65d80a1cc None None] Enqueued Resource ID: 164fc857-d51c-4742-a020-327769f83de7 with Priority: HIGHEST for action port [ 1223.988040] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 164fc857-d51c-4742-a020-327769f83de7 with Priority: HIGHEST for action port [ 1223.988729] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-164fc857-d51c-4742-a020-327769f83de7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.988729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-164fc857-d51c-4742-a020-327769f83de7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.988729] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-164fc857-d51c-4742-a020-327769f83de7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.988902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-164fc857-d51c-4742-a020-327769f83de7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.988902] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('164fc857-d51c-4742-a020-327769f83de7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.162283] env[65161]: INFO networking_nsxv3.common.synchronization [None req-74a4bea3-1ebf-4583-826f-d801f3e17a51 tempest-ServerActionsTestOtherB-176272064 tempest-ServerActionsTestOtherB-176272064-project-member] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1224.162853] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1224.163191] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.164892] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.164968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.165237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.165324] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.248261] env[65161]: INFO networking_nsxv3.common.synchronization [None req-fcbb7297-610c-4250-bf31-680ff3c3801a tempest-ServerActionsTestOtherB-176272064 tempest-ServerActionsTestOtherB-176272064-project-member] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1224.249248] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1224.249629] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.249782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.490873] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 164fc857-d51c-4742-a020-327769f83de7 [ 1224.491143] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.491282] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.491353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.491887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.491887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.491887] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:164fc857-d51c-4742-a020-327769f83de7 already deleted. [ 1224.491887] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-164fc857-d51c-4742-a020-327769f83de7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.687650] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.687809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.687809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.688096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.688224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.688349] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 already deleted. [ 1224.688481] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.688703] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.688939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.689058] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.216050] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.216050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.216050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.216050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.216050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.216050] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 already deleted. [ 1225.216050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.765672] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1225.765952] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 deletion is rescheduled due to dependency. [ 1225.765988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.203430] env[65161]: INFO networking_nsxv3.common.synchronization [None req-22dae774-7baa-4d78-925f-db6ab2511356 None None] Enqueued Resource ID: 45a90741-0f30-49d3-bca2-03ccc05532c6 with Priority: HIGHEST for action port [ 1226.204555] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45a90741-0f30-49d3-bca2-03ccc05532c6 with Priority: HIGHEST for action port [ 1226.205174] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-45a90741-0f30-49d3-bca2-03ccc05532c6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.205174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45a90741-0f30-49d3-bca2-03ccc05532c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.205174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45a90741-0f30-49d3-bca2-03ccc05532c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.205375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45a90741-0f30-49d3-bca2-03ccc05532c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.205375] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45a90741-0f30-49d3-bca2-03ccc05532c6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.709610] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45a90741-0f30-49d3-bca2-03ccc05532c6 [ 1226.709851] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.709979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.710055] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.710298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.710409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.710514] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45a90741-0f30-49d3-bca2-03ccc05532c6 already deleted. [ 1226.710590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45a90741-0f30-49d3-bca2-03ccc05532c6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.896872] env[65161]: INFO networking_nsxv3.common.synchronization [req-ab33865f-44c4-4ca3-83f4-731389f6a761 req-5a7be455-2c5e-4471-b168-d3a25920d468 tempest-ServerActionsTestOtherB-176272064 tempest-ServerActionsTestOtherB-176272064-project-member] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1229.897489] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1229.897800] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.897921] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.897987] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.898329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.898531] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.898671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.898763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.898949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.899082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.899206] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.205640] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.205861] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.206013] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.206422] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.206699] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.206877] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.206997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.207266] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.207505] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.207718] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1230.207839] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.207967] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.208092] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.208222] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1230.208331] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.208475] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.229634] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.229752] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1230.230082] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.230082] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.230423] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.230666] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.230749] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.231081] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.231359] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f42a66-7b19-423a-96c1-d9a3d0a86cb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.400976] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.401130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.401205] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.401429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.401522] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.401725] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.401831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.401882] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.402037] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.402114] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.402201] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 already deleted. [ 1230.402285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.734228] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.734496] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.734626] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.734918] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.735074] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.735236] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 47f42a66-7b19-423a-96c1-d9a3d0a86cb6 not found, creating... [ 1230.735501] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.735662] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.735778] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.735997] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.736147] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.736431] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.736590] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.736714] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.736933] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.737058] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.737201] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 47f42a66-7b19-423a-96c1-d9a3d0a86cb6 is going to be created. [ 1230.758496] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.758700] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.758817] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.759189] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.759370] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.759606] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.453086] env[65161]: INFO networking_nsxv3.common.synchronization [req-ab33865f-44c4-4ca3-83f4-731389f6a761 req-75d50d9c-0d0a-4741-9335-55b441b19e40 service nova] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1231.453364] env[65161]: INFO networking_nsxv3.common.synchronization [req-ab33865f-44c4-4ca3-83f4-731389f6a761 req-75d50d9c-0d0a-4741-9335-55b441b19e40 service nova] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1231.453680] env[65161]: INFO networking_nsxv3.common.synchronization [req-ab33865f-44c4-4ca3-83f4-731389f6a761 req-75d50d9c-0d0a-4741-9335-55b441b19e40 service nova] Enqueued Resource ID: 47f42a66-7b19-423a-96c1-d9a3d0a86cb6 with Priority: HIGHEST for action port [ 1231.453953] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1231.454131] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1231.454234] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f42a66-7b19-423a-96c1-d9a3d0a86cb6 with Priority: HIGHEST for action port [ 1231.454499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.454624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.454696] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.454917] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.455009] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.455966] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.455966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.456100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.456214] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.456422] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.456520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.456586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.456730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.457956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.457956] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.457956] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.457956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.457956] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.459500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.459500] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f42a66-7b19-423a-96c1-d9a3d0a86cb6',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.959865] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.960908] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.961099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.961171] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47f42a66-7b19-423a-96c1-d9a3d0a86cb6 with status ACTIVE [ 1231.961321] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.961423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.961487] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.961681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.961768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.961933] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.962406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.962406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.962406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.962406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.962609] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.962609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.962609] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.962763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.962809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.962902] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47f42a66-7b19-423a-96c1-d9a3d0a86cb6 is going to be updated. [ 1231.984182] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.984383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.984383] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.984557] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.984693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.984847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f42a66-7b19-423a-96c1-d9a3d0a86cb6" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.164708] env[65161]: INFO networking_nsxv3.common.synchronization [req-3e7c161e-bced-491b-8dc2-63431455d391 req-97ede85c-ae84-48ec-87a7-c9b0d172f79c tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1232.165399] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1232.165783] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.165927] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.165999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.166274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.166598] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.166687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.166750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.166945] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.167050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.167153] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.464817] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.514793] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.514931] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.515166] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.515601] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.516014] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.516273] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.516490] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.516820] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.517064] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.517433] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1232.517578] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1232.517768] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1232.517949] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1232.518150] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1232.518330] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1232.518997] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1232.538680] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1232.538896] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1232.539062] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1232.539267] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-865" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.539598] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-b11ba86a-1efc-4f29-b271-16d67f580434 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.539782] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-b11ba86a-1efc-4f29-b271-16d67f580434" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.539903] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-b11ba86a-1efc-4f29-b271-16d67f580434" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.540489] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-b11ba86a-1efc-4f29-b271-16d67f580434" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.540644] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b11ba86a-1efc-4f29-b271-16d67f580434',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.671486] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.671743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.671743] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.671931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.672034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.672234] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.672329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.672392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.672548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.672625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.672711] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1232.705991] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.706239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.706352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.706708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.706926] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.716861] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1232.968105] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.968105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.968105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.968393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.968439] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.968521] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be created. [ 1232.991540] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.991780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.991780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.992081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.992130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.005751] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: UNINITIALIZED for 2s [ 1233.043234] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.043450] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.043586] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.043936] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.044055] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.044208] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port b11ba86a-1efc-4f29-b271-16d67f580434 not found, creating... [ 1233.044513] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.044825] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.044987] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.045245] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.045406] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.045707] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.045873] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.045993] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.046224] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.046358] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.046543] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: b11ba86a-1efc-4f29-b271-16d67f580434 is going to be created. [ 1233.070407] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.070622] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.070767] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.071036] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.071270] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.071496] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-b11ba86a-1efc-4f29-b271-16d67f580434" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.773438] env[65161]: INFO networking_nsxv3.common.synchronization [req-3e7c161e-bced-491b-8dc2-63431455d391 req-e767bf52-d2ef-432f-9dba-57687e122c46 service nova] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 1233.773438] env[65161]: INFO networking_nsxv3.common.synchronization [req-3e7c161e-bced-491b-8dc2-63431455d391 req-e767bf52-d2ef-432f-9dba-57687e122c46 service nova] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1233.773438] env[65161]: INFO networking_nsxv3.common.synchronization [req-3e7c161e-bced-491b-8dc2-63431455d391 req-e767bf52-d2ef-432f-9dba-57687e122c46 service nova] Enqueued Resource ID: b11ba86a-1efc-4f29-b271-16d67f580434 with Priority: HIGHEST for action port [ 1233.773961] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_rules [ 1233.774196] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1233.774562] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11ba86a-1efc-4f29-b271-16d67f580434 with Priority: HIGHEST for action port [ 1233.774773] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.775040] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.775145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.775393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.775529] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.776860] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.777157] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.777243] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b11ba86a-1efc-4f29-b271-16d67f580434 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.777381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b11ba86a-1efc-4f29-b271-16d67f580434" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.777482] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b11ba86a-1efc-4f29-b271-16d67f580434" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.777753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b11ba86a-1efc-4f29-b271-16d67f580434" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.777836] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b11ba86a-1efc-4f29-b271-16d67f580434',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.280493] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b11ba86a-1efc-4f29-b271-16d67f580434 with status ACTIVE [ 1234.280813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.281015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.281164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.281421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.281560] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.281775] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.281943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.282039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.282208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.282288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.282467] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.282561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.282620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.282757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.282832] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.282916] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b11ba86a-1efc-4f29-b271-16d67f580434 is going to be updated. [ 1234.284109] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.284233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.316855] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.317064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.317064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.317341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.317523] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.317749] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b11ba86a-1efc-4f29-b271-16d67f580434" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.726559] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1234.726559] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 deletion is rescheduled due to dependency. [ 1234.726559] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.726837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.727035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.727229] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.727352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.727422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.727581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.727661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.727758] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.015743] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1235.016096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.016142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.016346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.016751] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.016905] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.016950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.017147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.017233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.017329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.017454] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.230106] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.519740] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.733890] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.023684] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 210b4a58-38b8-4467-91ac-a2d403afcd27: rpc.has_security_group_logging(os_id): False [ 1236.047378] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.047630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.047675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.047889] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.047975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.048249] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.048350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.048409] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.048570] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.048648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.048739] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be created. [ 1236.151352] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.151647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.151647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.151868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.152092] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.165998] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1236.236825] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.237075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.237075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.237325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.237416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.237538] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1236.302302] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.302589] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.302734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.303173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.303595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.314999] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1238.177623] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1238.177967] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.325703] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1238.325938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.326134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.326374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.326623] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.326776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.326842] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.327015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.327088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.327184] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.327273] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.775232] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1238.775870] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1238.829507] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.332160] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dad00945-a380-4452-8a37-64cfdbf9d432: rpc.has_security_group_logging(os_id): False [ 1239.351400] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.351758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.351758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.351839] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.351955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.352194] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.352295] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.352370] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.352503] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.352580] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.352666] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1239.415533] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.415736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.415736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.415933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.416126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.430949] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1241.450325] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1241.450325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.886078] env[65161]: INFO networking_nsxv3.common.synchronization [req-0f5190f3-fad7-4493-abbf-0c0f22e400e2 req-ddf036a2-a601-4500-a6f6-e23e1abb7af8 tempest-AttachVolumeNegativeTest-1311327771 tempest-AttachVolumeNegativeTest-1311327771-project-member] Enqueued Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_members [ 1242.886596] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGHEST for action security_group_members [ 1242.886878] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a3857b-abc1-464f-9b15-c97784bb1930 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.886998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.887158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.887276] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.887663] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.887663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.887663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.887663] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.887844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.887844] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.392460] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.392669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.392717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.392899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.413623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.414038] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.414195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.414281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.414466] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.414545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.414638] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a3857b-abc1-464f-9b15-c97784bb1930 is going to be updated. [ 1243.465065] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.465418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.465493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.465717] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.465863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.476021] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a3857b-abc1-464f-9b15-c97784bb1930 in Status: IN_PROGRESS for 2s [ 1245.488551] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a3857b-abc1-464f-9b15-c97784bb1930 in Status: SUCCESS [ 1245.488938] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a3857b-abc1-464f-9b15-c97784bb1930 deletion is rescheduled due to dependency. [ 1245.488938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.530339] env[65161]: INFO networking_nsxv3.common.synchronization [req-b9c19c36-575a-4e76-8b47-9a0fd7886171 req-02b0462e-74c9-4bd4-9086-8d2146dec2c3 tempest-DeleteServersTestJSON-239873184 tempest-DeleteServersTestJSON-239873184-project-member] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1245.530339] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGHEST for action security_group_members [ 1245.530339] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.530339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.530339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.530339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.531073] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.531073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.531073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.531073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.531073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.531293] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.034494] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.034715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.034765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.034991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.035105] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.035317] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.035452] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.035520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.035686] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.035766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.035852] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be updated. [ 1246.074340] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.074340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.074340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.074340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.074340] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.083560] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: IN_PROGRESS for 2s [ 1248.095761] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ad3588-f61e-418d-9a8e-c65add44c1be in Status: SUCCESS [ 1248.096177] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be deletion is rescheduled due to dependency. [ 1248.096233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.531013] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.531492] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1254.634730] env[65161]: INFO networking_nsxv3.common.synchronization [None req-41d53671-5207-4349-95aa-b7db7eadf29e None None] Enqueued Resource ID: 9207c570-12f7-49e2-8576-8d3a766ea576 with Priority: HIGHEST for action port [ 1254.635058] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9207c570-12f7-49e2-8576-8d3a766ea576 with Priority: HIGHEST for action port [ 1254.635579] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9207c570-12f7-49e2-8576-8d3a766ea576 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.635728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9207c570-12f7-49e2-8576-8d3a766ea576" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.635798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9207c570-12f7-49e2-8576-8d3a766ea576" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.636014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9207c570-12f7-49e2-8576-8d3a766ea576" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.636102] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9207c570-12f7-49e2-8576-8d3a766ea576',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.138800] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9207c570-12f7-49e2-8576-8d3a766ea576 [ 1255.138800] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.138800] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.139191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.139191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.139191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.139352] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9207c570-12f7-49e2-8576-8d3a766ea576 already deleted. [ 1255.139352] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9207c570-12f7-49e2-8576-8d3a766ea576" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.271105] env[65161]: INFO networking_nsxv3.common.synchronization [None req-e05807e7-606c-4371-be07-3e2bcbb2afa5 tempest-AttachVolumeShelveTestJSON-33399502 tempest-AttachVolumeShelveTestJSON-33399502-project-member] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_rules [ 1255.271633] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_rules [ 1255.271952] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.272498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.272498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.272498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.272632] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.365746] env[65161]: INFO networking_nsxv3.common.synchronization [None req-b9584bdf-caaf-41f1-9c98-329127a6bcc8 tempest-AttachVolumeShelveTestJSON-33399502 tempest-AttachVolumeShelveTestJSON-33399502-project-member] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_rules [ 1255.366339] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_rules [ 1255.366653] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.366813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.796790] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.797145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.797145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.797555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.797742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.797925] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 already deleted. [ 1255.798109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.798381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.798672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.798853] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.340128] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.340285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.340389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.340697] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.340787] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.340961] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 already deleted. [ 1256.341062] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.201175] env[65161]: INFO networking_nsxv3.common.synchronization [None req-5aa8b897-709e-42d2-85d6-4ec9ef4958d1 None None] Enqueued Resource ID: 6da9ce7f-d7d2-48c4-9e97-84267893dfd1 with Priority: HIGHEST for action port [ 1257.202078] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6da9ce7f-d7d2-48c4-9e97-84267893dfd1 with Priority: HIGHEST for action port [ 1257.202781] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-6da9ce7f-d7d2-48c4-9e97-84267893dfd1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.202899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6da9ce7f-d7d2-48c4-9e97-84267893dfd1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.202955] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6da9ce7f-d7d2-48c4-9e97-84267893dfd1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.203345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6da9ce7f-d7d2-48c4-9e97-84267893dfd1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.203514] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6da9ce7f-d7d2-48c4-9e97-84267893dfd1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.706419] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6da9ce7f-d7d2-48c4-9e97-84267893dfd1 [ 1257.706661] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.706903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.707027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.707253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.707345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.707452] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6da9ce7f-d7d2-48c4-9e97-84267893dfd1 already deleted. [ 1257.707541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6da9ce7f-d7d2-48c4-9e97-84267893dfd1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.910400] env[65161]: INFO networking_nsxv3.common.synchronization [req-54f9c9ae-64a1-4378-81b8-12f7b62154c3 req-73cbb79b-c9a3-4972-8626-0acc9f402926 tempest-AttachVolumeShelveTestJSON-33399502 tempest-AttachVolumeShelveTestJSON-33399502-project-member] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_members [ 1260.910924] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_members [ 1260.911255] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.911379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.911449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.911739] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.911896] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.911996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.912077] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.912224] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.912308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.912402] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.195754] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.195754] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.196026] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.196247] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.196544] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.196708] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.196869] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.197115] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.197279] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.197505] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1261.197627] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1261.197786] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1261.197868] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1261.198027] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1261.198133] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1261.198272] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1261.217981] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1261.218204] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1261.218347] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1261.218504] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.218823] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-e659a1c3-efd1-46da-a161-2310e525a6f1 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.219022] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.219239] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.219519] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.219670] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e659a1c3-efd1-46da-a161-2310e525a6f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.414272] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.414847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.414847] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.415030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.415030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.415233] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.415338] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.415416] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.415606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.415695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.415786] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 already deleted. [ 1261.415906] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.722698] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.722942] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.723086] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.723382] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.723531] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.723691] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port e659a1c3-efd1-46da-a161-2310e525a6f1 not found, creating... [ 1261.723957] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.724214] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.724291] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.724553] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.724703] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.724990] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.725164] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.725283] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.725489] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.725623] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.725763] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: e659a1c3-efd1-46da-a161-2310e525a6f1 is going to be created. [ 1261.748567] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.748793] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.748876] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.749260] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.749568] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.749888] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.433546] env[65161]: INFO networking_nsxv3.common.synchronization [req-54f9c9ae-64a1-4378-81b8-12f7b62154c3 req-48007feb-7d9b-401f-aa99-77f069f03d0f service nova] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_rules [ 1262.433863] env[65161]: INFO networking_nsxv3.common.synchronization [req-54f9c9ae-64a1-4378-81b8-12f7b62154c3 req-48007feb-7d9b-401f-aa99-77f069f03d0f service nova] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_members [ 1262.433863] env[65161]: INFO networking_nsxv3.common.synchronization [req-54f9c9ae-64a1-4378-81b8-12f7b62154c3 req-48007feb-7d9b-401f-aa99-77f069f03d0f service nova] Enqueued Resource ID: e659a1c3-efd1-46da-a161-2310e525a6f1 with Priority: HIGHEST for action port [ 1262.434374] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_rules [ 1262.434510] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_members [ 1262.434606] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e659a1c3-efd1-46da-a161-2310e525a6f1 with Priority: HIGHEST for action port [ 1262.434928] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.435017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.435294] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.435457] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.435543] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.436889] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.436991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.437100] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.437281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.437458] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.437536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.437595] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.437734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.437821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.437971] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.441013] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e659a1c3-efd1-46da-a161-2310e525a6f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.441130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.441356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.441356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.441468] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e659a1c3-efd1-46da-a161-2310e525a6f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.937902] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.938160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.944527] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e659a1c3-efd1-46da-a161-2310e525a6f1 with status ACTIVE [ 1262.944753] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.944866] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.944961] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.945169] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.945264] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.945436] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.945535] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.945674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.945740] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.945840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.945993] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.946127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.946191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.946287] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.946365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.946434] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e659a1c3-efd1-46da-a161-2310e525a6f1 is going to be updated. [ 1262.947577] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.967967] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.968203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.968203] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.968389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.968527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.968687] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.172476] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1263.172683] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:3 started [ 1263.450327] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.953137] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.953322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.953404] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.953582] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.953669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.953765] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 is going to be created. [ 1263.978225] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.978447] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.978506] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.978691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.978849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.989784] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: UNINITIALIZED for 2s [ 1266.001658] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: SUCCESS [ 1266.002051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.002051] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.002261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.002456] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.002574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.002641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.002790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.002872] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.002958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.003064] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.505689] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.008385] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02655a7e-7e60-4267-846f-044d2c05ff76: rpc.has_security_group_logging(os_id): False [ 1267.025911] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.026223] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.026331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.026555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.026647] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.026937] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.027064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.027112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.027271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.027568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.027568] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 is going to be created. [ 1267.093140] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.093362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.093362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.093566] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.093747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.103320] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: IN_PROGRESS for 2s [ 1267.435365] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.435514] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1269.116498] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: SUCCESS [ 1269.116821] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.929963] env[65161]: INFO networking_nsxv3.common.synchronization [req-95b7d927-f292-48b4-86fa-e00c2a2ba2c5 req-b60ba49e-e9f0-460e-ad73-8ee80720fd43 tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 1269.930535] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 1269.930977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.930977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.931122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.931252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.931368] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.931459] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.931563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.931727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.931845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.931965] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.434647] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.937342] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.440072] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.440072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.440072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.440072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.440072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.440620] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be updated. [ 1271.481503] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.481673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.481719] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.481934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.482096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.491850] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: IN_PROGRESS for 2s [ 1273.503835] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 1273.504115] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.931396] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.931747] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1279.933264] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.933663] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1284.935090] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.935405] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.413947] env[65161]: INFO networking_nsxv3.common.synchronization [req-98085dc7-1cde-4671-a83b-4c4b7b9f603f req-e1900517-7a8e-43f0-b41e-27905634a6ab tempest-ServerActionsTestOtherA-1730320298 tempest-ServerActionsTestOtherA-1730320298-project-member] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 1286.414452] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGHEST for action security_group_members [ 1286.414808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.414940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.415023] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.415236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.415407] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.415528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.415587] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.415758] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.415849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.415959] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.918803] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.919053] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.919156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.919402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.919501] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.919715] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.919817] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.919880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.921017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.921017] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.921017] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be updated. [ 1286.956417] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.956616] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.956669] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.956884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.957039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.967162] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: IN_PROGRESS for 2s [ 1288.121335] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.121846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.121846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.121985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.122091] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.624127] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.981184] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 in Status: SUCCESS [ 1288.981475] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 deletion is rescheduled due to dependency. [ 1288.981621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.126299] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.629510] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1289.629623] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1290.564027] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.564027] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.564411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.564411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.577938] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1290.578813] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.579836] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1290.617777] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.617970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.617970] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.618284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.635583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.635583] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1290.635583] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1290.635583] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1290.682362] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.682730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.682730] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.682902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.684472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.684750] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1290.787137] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.787418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.787418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.787650] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.787831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.788240] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1290.886301] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.886586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.886586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.886873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.887319] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.887681] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1290.887820] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'715edd9d-de1e-4ad5-b572-5f9f1ef01e31', '02655a7e-7e60-4267-846f-044d2c05ff76', '210b4a58-38b8-4467-91ac-a2d403afcd27', '06d910b0-5a99-40f2-ba32-49a643c7766c', '6e78a476-55e3-4a4a-ac0a-0627c95c4cfa', 'c6a3857b-abc1-464f-9b15-c97784bb1930', '72c3d008-c3df-415c-97a1-58c326239709', 'd21165f7-b2bc-43ce-8cb7-61f74b45df43', '2c187a3f-ed28-483a-9906-11a9f2cce3f3', '64d87f90-5895-4771-acb4-8aaeff02c417', '07ad3588-f61e-418d-9a8e-c65add44c1be', 'ac40d56d-7d37-468b-9192-2bd9518b5b77', '200ba9e0-f56c-4b5d-9e39-69a507140fda', '0f6a93f2-4e06-4cd8-9bde-77501efa88f4', '4f3f5db7-3498-4e05-bcb9-8b2bc31fa377', '7caaaa94-1988-4a64-baf8-2e9ad4c3a553', 'f3e3e485-b210-4594-a46e-85922cc804cf', '68ff1a7f-59cd-4081-9af0-9322734ba92b', '5eae70bb-b2d5-4683-837e-e701a57929f1', '5e2ddd89-773b-40cd-95c8-c99371221138', 'dad00945-a380-4452-8a37-64cfdbf9d432', '20c8c1aa-e142-4f0d-9654-9180daa1078e', '490d862d-f7b2-497d-912a-e1801d9b16ad', '1d23f6bd-c3d6-4abc-b853-77560027d5d9', '48e5829e-83e0-44d7-b9e9-c3210ec30d0d', '9806617c-3cbb-4c3f-98c8-9af6c5b4dc39', '70c8e546-9b00-4441-97c1-cb8beb5cab1f', '4f5866be-f91a-4727-a28f-3e308ac779d0', '2ba62457-a546-42c0-916a-d1efa9c77ee4', 'c38cb053-aec9-4ead-86a8-4aa3f2154903', 'cb265379-c4fb-47cf-afb5-2c655df91dbf', 'cc716056-e80f-437c-a978-42b0cd24b9c7', '1b4da512-0ef0-4e5a-aad1-7eff0f72d14f', 'e24f796e-b77b-42f0-a7c2-ae92228b28c5', '45c3c240-33f4-4e4c-b0dc-526406810cce', 'aa3f13db-d36f-47b7-bca4-30b32f714725', '28f6a198-5899-42cf-bfcf-d51f32053a44', 'a004fc9f-8188-4952-8c7f-947ab65480c2', '6815e7f8-d060-497e-9594-0ed8cadfdffe', 'b59bd654-2015-4855-bb01-60ad0a84a0b0', 'bb437f4e-1421-44f7-a301-63abddb16aa0', 'd592aa9d-8cc0-42f6-959d-30654012ec4e', 'c9f4e7d3-15ff-431e-9c10-7ea15b2417ee', 'e6704a80-3529-40ab-83a5-1a8a6167b498'} {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1290.887979] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1290.908898] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.909229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.909229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.909366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.909366] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.909535] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1290.909627] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1290.909682] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1291.008140] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.008140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.008140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.008140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.009519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.009717] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1291.009800] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1291.009885] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1291.009984] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1291.010093] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1291.010208] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGH for action security_group_rules [ 1291.010260] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGH for action security_group_rules [ 1291.010347] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGH for action security_group_rules [ 1291.010404] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGH for action security_group_rules [ 1291.010455] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGH for action security_group_rules [ 1291.010540] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGH for action security_group_rules [ 1291.010626] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGH for action security_group_rules [ 1291.010729] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGH for action security_group_rules [ 1291.010808] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGH for action security_group_rules [ 1291.010849] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGH for action security_group_rules [ 1291.010884] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGH for action security_group_rules [ 1291.010972] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGH for action security_group_rules [ 1291.011053] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGH for action security_group_rules [ 1291.011118] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGH for action security_group_rules [ 1291.011181] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGH for action security_group_rules [ 1291.011269] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGH for action security_group_rules [ 1291.011332] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGH for action security_group_rules [ 1291.011474] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGH for action security_group_rules [ 1291.011474] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGH for action security_group_rules [ 1291.011586] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGH for action security_group_rules [ 1291.011702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.415521] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.415700] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1291.415815] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 with Priority: HIGH for action security_group_rules [ 1291.415996] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGH for action security_group_rules [ 1291.416160] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c3d008-c3df-415c-97a1-58c326239709 with Priority: HIGH for action security_group_rules [ 1291.416303] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 with Priority: HIGH for action security_group_rules [ 1291.416428] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e2ddd89-773b-40cd-95c8-c99371221138 with Priority: HIGH for action security_group_rules [ 1291.416546] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 with Priority: HIGH for action security_group_rules [ 1291.416683] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b with Priority: HIGH for action security_group_rules [ 1291.416798] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e3e485-b210-4594-a46e-85922cc804cf with Priority: HIGH for action security_group_rules [ 1291.416906] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 with Priority: HIGH for action security_group_rules [ 1291.417033] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 with Priority: HIGH for action security_group_rules [ 1291.417195] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda with Priority: HIGH for action security_group_rules [ 1291.417326] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 with Priority: HIGH for action security_group_rules [ 1291.417440] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ad3588-f61e-418d-9a8e-c65add44c1be with Priority: HIGH for action security_group_rules [ 1291.417549] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64d87f90-5895-4771-acb4-8aaeff02c417 with Priority: HIGH for action security_group_rules [ 1291.417664] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 with Priority: HIGH for action security_group_rules [ 1291.417777] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a3857b-abc1-464f-9b15-c97784bb1930 with Priority: HIGH for action security_group_rules [ 1291.417900] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 with Priority: HIGH for action security_group_rules [ 1291.418022] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa with Priority: HIGH for action security_group_rules [ 1291.418164] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGH for action security_group_rules [ 1291.418280] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d910b0-5a99-40f2-ba32-49a643c7766c with Priority: HIGH for action security_group_rules [ 1291.418680] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.418856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.418934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.419227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.419340] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('715edd9d-de1e-4ad5-b572-5f9f1ef01e31',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.420483] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.420621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.420722] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.420931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.421034] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.422843] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72c3d008-c3df-415c-97a1-58c326239709 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.422843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.422843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.422843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.422843] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72c3d008-c3df-415c-97a1-58c326239709',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.423995] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.423995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.423995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.423995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.423995] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f3f5db7-3498-4e05-bcb9-8b2bc31fa377',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.425528] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e2ddd89-773b-40cd-95c8-c99371221138 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.425528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.425528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.425528] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.425528] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e2ddd89-773b-40cd-95c8-c99371221138',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.425860] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5eae70bb-b2d5-4683-837e-e701a57929f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.426034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.426034] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.426542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.426542] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5eae70bb-b2d5-4683-837e-e701a57929f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.427039] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68ff1a7f-59cd-4081-9af0-9322734ba92b taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.427311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.427311] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.427414] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.427489] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68ff1a7f-59cd-4081-9af0-9322734ba92b',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.428776] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3e3e485-b210-4594-a46e-85922cc804cf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.428776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.428776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.428776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.428776] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3e3e485-b210-4594-a46e-85922cc804cf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.429243] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.429467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.429467] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.429670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.429670] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f6a93f2-4e06-4cd8-9bde-77501efa88f4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.430890] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.430890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.430890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.430890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.430890] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7caaaa94-1988-4a64-baf8-2e9ad4c3a553',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.431608] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-200ba9e0-f56c-4b5d-9e39-69a507140fda taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.431677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.431677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.431864] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.431927] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('200ba9e0-f56c-4b5d-9e39-69a507140fda',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.432624] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac40d56d-7d37-468b-9192-2bd9518b5b77 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.432742] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.432798] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.432958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.433052] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac40d56d-7d37-468b-9192-2bd9518b5b77',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.433737] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ad3588-f61e-418d-9a8e-c65add44c1be taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.433843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.433928] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.434093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.434169] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ad3588-f61e-418d-9a8e-c65add44c1be',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.434790] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64d87f90-5895-4771-acb4-8aaeff02c417 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.434916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.435393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.435393] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.435393] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64d87f90-5895-4771-acb4-8aaeff02c417',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.436201] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.436307] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.436376] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.436537] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.436605] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c187a3f-ed28-483a-9906-11a9f2cce3f3',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.437311] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a3857b-abc1-464f-9b15-c97784bb1930 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.437425] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.437492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.437639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.437722] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a3857b-abc1-464f-9b15-c97784bb1930',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.439339] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.439339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.439339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.439339] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.439665] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d21165f7-b2bc-43ce-8cb7-61f74b45df43',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.441017] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.441218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.441218] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.441331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.441422] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e78a476-55e3-4a4a-ac0a-0627c95c4cfa',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.442124] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.442233] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.442314] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.442475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.442547] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.443313] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d910b0-5a99-40f2-ba32-49a643c7766c taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.443422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.443483] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.443641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.443721] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d910b0-5a99-40f2-ba32-49a643c7766c',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.472670] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.472896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.472896] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.473128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.531252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.531357] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e2ddd89-773b-40cd-95c8-c99371221138 is going to be deleted. [ 1291.604901] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.605329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.605329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.605437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.605480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.605585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e2ddd89-773b-40cd-95c8-c99371221138" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.951136] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.951136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.951136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.951136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.951136] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.951136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.951136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.951136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.951136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.951136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.951136] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.956984] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.956984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.956984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.957272] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.957378] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.957475] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.957538] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.957707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.957791] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.957876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.957961] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.023022] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.023189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.023261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.023469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.028331] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.028331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.035657] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.035785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.037074] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.037213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.038008] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.038134] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.038887] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.038980] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.039979] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.040075] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.040771] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.040857] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.041542] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.041640] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.042350] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.042437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.043328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.043429] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.044147] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1292.044573] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.044680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.045756] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1292.046185] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.046286] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.047874] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1292.048312] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.048410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.050687] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1292.051125] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.051250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.055639] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1292.056183] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.056411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.057028] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1292.057435] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.057556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.061574] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1292.061848] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.062713] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f3f5db7-3498-4e05-bcb9-8b2bc31fa377 is going to be deleted. [ 1292.063237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.063451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.100500] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.100673] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ad3588-f61e-418d-9a8e-c65add44c1be is going to be deleted. [ 1292.101625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.102541] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.123028] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.123028] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac40d56d-7d37-468b-9192-2bd9518b5b77 is going to be deleted. [ 1292.123849] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.124083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.149459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.149622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.151586] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.151773] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64d87f90-5895-4771-acb4-8aaeff02c417 is going to be deleted. [ 1292.152635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.152831] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.178884] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.179230] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d21165f7-b2bc-43ce-8cb7-61f74b45df43 is going to be deleted. [ 1292.181227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.181498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.207051] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.207297] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.225701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.225945] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5eae70bb-b2d5-4683-837e-e701a57929f1 is going to be deleted. [ 1292.226852] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.227213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.265977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.266254] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.280287] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.280543] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.290410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.290650] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e78a476-55e3-4a4a-ac0a-0627c95c4cfa is going to be deleted. [ 1292.292080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.292344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.356521] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.356693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.397913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.398682] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3e3e485-b210-4594-a46e-85922cc804cf is going to be deleted. [ 1292.399401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.399681] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.440489] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.440752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.465239] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.466414] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.472130] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.472294] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 200ba9e0-f56c-4b5d-9e39-69a507140fda is going to be deleted. [ 1292.473350] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.473548] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.506514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.506818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.567695] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.567898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.568952] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.569084] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c187a3f-ed28-483a-9906-11a9f2cce3f3 is going to be deleted. [ 1292.570054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.570290] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.617629] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.618044] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f6a93f2-4e06-4cd8-9bde-77501efa88f4 is going to be deleted. [ 1292.618715] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.618939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.674422] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.674608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.698765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.699054] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 715edd9d-de1e-4ad5-b572-5f9f1ef01e31 is going to be deleted. [ 1292.700405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.700657] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.764428] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.764428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.783095] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.783095] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72c3d008-c3df-415c-97a1-58c326239709 is going to be deleted. [ 1292.784253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.784493] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.827173] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.827405] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.841766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.841961] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a3857b-abc1-464f-9b15-c97784bb1930 is going to be deleted. [ 1292.842897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.843174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.909536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.909726] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7caaaa94-1988-4a64-baf8-2e9ad4c3a553 is going to be deleted. [ 1292.910737] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.910988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.964397] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.964599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.967962] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02655a7e-7e60-4267-846f-044d2c05ff76: rpc.has_security_group_logging(os_id): False [ 1292.969234] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 210b4a58-38b8-4467-91ac-a2d403afcd27: rpc.has_security_group_logging(os_id): False [ 1292.974139] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.974318] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.986441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.986684] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68ff1a7f-59cd-4081-9af0-9322734ba92b is going to be deleted. [ 1292.987726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.988008] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.045322] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.045514] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d910b0-5a99-40f2-ba32-49a643c7766c is going to be deleted. [ 1293.046621] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.046879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.046999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.047219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f3f5db7-3498-4e05-bcb9-8b2bc31fa377" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.047437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.047651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.047747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.047913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ad3588-f61e-418d-9a8e-c65add44c1be" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.048577] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.048783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.048934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.049102] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac40d56d-7d37-468b-9192-2bd9518b5b77" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.049310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.049502] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.049628] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.049766] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64d87f90-5895-4771-acb4-8aaeff02c417" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.049937] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.050128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.050238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.050389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d21165f7-b2bc-43ce-8cb7-61f74b45df43" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.050545] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.050736] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.050830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.050990] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5eae70bb-b2d5-4683-837e-e701a57929f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.051174] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.051356] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.051472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.051601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e78a476-55e3-4a4a-ac0a-0627c95c4cfa" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.051788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.051964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.052082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.052247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3e3e485-b210-4594-a46e-85922cc804cf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.052408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.052592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.052700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.052846] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-200ba9e0-f56c-4b5d-9e39-69a507140fda" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.053030] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.053201] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.053313] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.053460] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c187a3f-ed28-483a-9906-11a9f2cce3f3" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.053625] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.053812] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.053985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.054103] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f6a93f2-4e06-4cd8-9bde-77501efa88f4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.054321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.054561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.054699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.054880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-715edd9d-de1e-4ad5-b572-5f9f1ef01e31" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.055123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.055292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.055374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.055485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72c3d008-c3df-415c-97a1-58c326239709" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.058902] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.059057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.059131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.059292] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.061059] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.061164] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.093099] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.093317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.126551] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.126907] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.127035] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.127107] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.127418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.127588] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.127644] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1293.128898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.129125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.150831] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.150985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.180108] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.180252] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.197653] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.198019] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.198167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.198331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.198592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.198732] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.198902] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 is going to be updated. [ 1293.200267] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.200515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.200623] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.200807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a3857b-abc1-464f-9b15-c97784bb1930" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.200979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.201204] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.201327] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.201496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7caaaa94-1988-4a64-baf8-2e9ad4c3a553" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.201759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.201861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.201991] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.202135] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68ff1a7f-59cd-4081-9af0-9322734ba92b" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.304025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.304265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.304265] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.304511] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.304568] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.304694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d910b0-5a99-40f2-ba32-49a643c7766c" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.349754] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.349988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.349988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.350220] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.350374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.399491] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.399705] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.399768] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.399941] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.400108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.424472] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1293.480978] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: IN_PROGRESS for 2s [ 1293.756591] env[65161]: INFO networking_nsxv3.common.synchronization [req-d4b199d9-2b0f-4bdb-96aa-04b46841fd0e req-1d6730a4-c32e-4778-b3be-56a0f326ed62 tempest-ServerActionsTestJSON-650482093 tempest-ServerActionsTestJSON-650482093-project-member] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1293.756997] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGHEST for action security_group_members [ 1293.757553] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.757918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.757918] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.758043] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.758159] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.758472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.758563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.758720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.759065] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.759065] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.262577] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.262757] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.262830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.263082] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.286324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.286575] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.286695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.286763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.286968] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.287067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.287182] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be updated. [ 1294.338752] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.338752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.338752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.338752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.338752] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.349299] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: IN_PROGRESS for 2s [ 1295.446864] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1295.447296] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.497641] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: SUCCESS [ 1295.497883] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.358621] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad00945-a380-4452-8a37-64cfdbf9d432 in Status: SUCCESS [ 1296.358825] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 deletion is rescheduled due to dependency. [ 1296.358897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.759047] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.759047] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.760125] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.760552] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1308.762136] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.762521] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.763304] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.763667] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1318.764677] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.764677] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.765392] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.765873] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1328.767380] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.767380] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.768411] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.768787] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1338.769982] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.770355] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.725657] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.726050] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.726050] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.726260] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.726516] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.726745] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.726889] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.727113] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.727259] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.727463] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1342.727572] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1342.727701] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1342.727814] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1342.727923] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1342.728036] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.728169] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.750859] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.751073] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1342.751295] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.751519] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.751843] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-e659a1c3-efd1-46da-a161-2310e525a6f1 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.752044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.752176] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.752440] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.752571] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e659a1c3-efd1-46da-a161-2310e525a6f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.255508] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.255770] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.255889] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.256195] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.256344] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.256620] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.256773] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.256888] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.257116] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.257253] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.257528] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.257721] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.257825] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.258029] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.258163] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.258292] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: e659a1c3-efd1-46da-a161-2310e525a6f1 is going to be updated. [ 1343.287210] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.287446] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.287595] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.287870] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.288085] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.288339] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.772262] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.772262] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1343.971431] env[65161]: INFO networking_nsxv3.common.synchronization [req-e94ba017-0edd-4315-aa94-c80de80901f7 req-62452dce-8e00-4ad6-924e-189392947070 service nova] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_rules [ 1343.971733] env[65161]: INFO networking_nsxv3.common.synchronization [req-e94ba017-0edd-4315-aa94-c80de80901f7 req-62452dce-8e00-4ad6-924e-189392947070 service nova] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_members [ 1343.971894] env[65161]: INFO networking_nsxv3.common.synchronization [req-e94ba017-0edd-4315-aa94-c80de80901f7 req-62452dce-8e00-4ad6-924e-189392947070 service nova] Enqueued Resource ID: e659a1c3-efd1-46da-a161-2310e525a6f1 with Priority: HIGHEST for action port [ 1343.972435] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_rules [ 1343.972580] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_members [ 1343.972670] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e659a1c3-efd1-46da-a161-2310e525a6f1 with Priority: HIGHEST for action port [ 1343.972945] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.973081] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.973147] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.973349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.973431] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.974381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.974496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.974610] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.974775] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.974902] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.975011] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.975084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.975263] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.976166] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.976166] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.976279] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-e659a1c3-efd1-46da-a161-2310e525a6f1 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.976585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.976585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.976585] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.976741] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e659a1c3-efd1-46da-a161-2310e525a6f1',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.478615] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.479647] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.479771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.481556] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e659a1c3-efd1-46da-a161-2310e525a6f1 with status ACTIVE [ 1344.481741] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.481914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.481914] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.482129] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.482219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.482389] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.482488] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.482556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.482700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.482778] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.482981] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.483088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.483145] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.483281] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.483353] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.483435] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e659a1c3-efd1-46da-a161-2310e525a6f1 is going to be updated. [ 1344.506441] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.506441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.506563] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.506693] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.506799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.506998] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e659a1c3-efd1-46da-a161-2310e525a6f1" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.981192] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.483358] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.483581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.483635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.483818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.483907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.484020] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 is going to be updated. [ 1345.517114] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.517321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.517321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.517542] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.517727] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.526377] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: IN_PROGRESS for 2s [ 1347.538239] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: SUCCESS [ 1347.538532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.538704] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.538973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.539193] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.539345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.539410] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.539596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.539691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.539790] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.539894] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.043903] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.546177] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02655a7e-7e60-4267-846f-044d2c05ff76: rpc.has_security_group_logging(os_id): False [ 1348.564031] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.564271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.564377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.564578] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.564678] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.564958] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.565094] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.565161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.565315] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.565392] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.565481] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 is going to be updated. [ 1348.624618] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.624899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.624899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.625138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.625355] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.643409] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: IN_PROGRESS for 2s [ 1348.973418] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.973418] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1350.661209] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: SUCCESS [ 1350.661643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.974735] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.975118] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.975770] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.975770] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.717767] env[65161]: INFO networking_nsxv3.common.synchronization [req-ffd7cd88-9906-4709-9225-874262a57cbe req-dcade2af-e438-4a40-9be7-4b2d375e2e6b tempest-ServerActionsTestOtherB-176272064 tempest-ServerActionsTestOtherB-176272064-project-member] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1361.718613] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1361.718899] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.719085] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.719167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.719374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.719536] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.719639] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.719702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.719844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.719930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.720033] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.222779] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.222996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.222996] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.223213] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.223301] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.223521] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.223620] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.223744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.223865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.223943] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.224066] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1362.255798] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.256072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.256072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.256245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.256384] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.264992] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1364.275495] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1364.275897] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 deletion is rescheduled due to dependency. [ 1364.275897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.719833] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.720309] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.702505] env[65161]: INFO networking_nsxv3.common.synchronization [req-f96bab6a-478d-409f-9f89-7956e36283a6 req-b5ed8c21-2f3b-4760-803a-0a6f317e9520 tempest-ServerActionsTestOtherB-176272064 tempest-ServerActionsTestOtherB-176272064-project-member] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1368.703101] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1368.703394] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.703521] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.703591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.703824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.703945] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.704520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.704520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.704520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.704520] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.704743] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.992046] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.992276] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.992406] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.992671] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.992932] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.993101] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.993216] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.993444] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.993579] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.993784] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1368.993895] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1368.994009] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1368.994124] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1368.994230] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1368.994332] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1368.994459] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1369.014752] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1369.014964] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1369.015108] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1369.015283] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.015592] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.015764] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.015896] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.016247] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.016380] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.208217] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.208432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.208432] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.208618] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.208709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.208918] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.209053] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.209173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.209249] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.209331] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.209422] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1369.237175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.237465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.237465] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.237708] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.237876] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.248709] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1369.518268] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.518530] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.518620] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.518931] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.519095] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.519267] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port 9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f not found, creating... [ 1369.519518] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.519674] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.519793] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.520027] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.520205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.520495] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.520645] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.520763] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.520965] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.521117] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.521254] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: 9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f is going to be created. [ 1369.541961] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.542199] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.542301] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.542613] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.542787] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.543021] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.244278] env[65161]: INFO networking_nsxv3.common.synchronization [req-f96bab6a-478d-409f-9f89-7956e36283a6 req-2acea3d7-aea4-4b2e-a26b-bfb8c5f9f8d6 service nova] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1370.244542] env[65161]: INFO networking_nsxv3.common.synchronization [req-f96bab6a-478d-409f-9f89-7956e36283a6 req-2acea3d7-aea4-4b2e-a26b-bfb8c5f9f8d6 service nova] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1370.244589] env[65161]: INFO networking_nsxv3.common.synchronization [req-f96bab6a-478d-409f-9f89-7956e36283a6 req-2acea3d7-aea4-4b2e-a26b-bfb8c5f9f8d6 service nova] Enqueued Resource ID: 9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f with Priority: HIGHEST for action port [ 1370.245106] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1370.245253] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1370.245329] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f with Priority: HIGHEST for action port [ 1370.245603] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.245723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.245828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.246015] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.246183] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.246936] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.247048] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.247244] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.247345] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.247407] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.247583] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.247660] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.749814] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.750064] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.750133] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f with status ACTIVE [ 1370.750260] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.750387] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.750451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.750662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.750750] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.750916] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.751024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.751086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.751240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.751310] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.751481] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.751572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.751632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.751765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.751838] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.751919] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f is going to be updated. [ 1370.775076] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.775379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.775379] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.775485] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.775622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.775782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c27057e-5bc5-4f5b-a0c8-9728bb7c7b1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.259710] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1371.260126] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 deletion is rescheduled due to dependency. [ 1371.260126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.260219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.260453] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.260639] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.260761] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.260826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.260978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.261073] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.261171] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.763762] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.266494] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.769709] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.769709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.769709] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.769949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.769949] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.770091] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1372.797623] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.797777] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.797824] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.798090] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.798236] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.806419] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1374.817282] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1374.817670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.817670] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.817950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.818225] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.818374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.818443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.818651] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.818759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.818886] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.819019] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.246142] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.246354] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1375.320824] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.823146] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 210b4a58-38b8-4467-91ac-a2d403afcd27: rpc.has_security_group_logging(os_id): False [ 1375.842123] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.842365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.842472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.842818] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.842953] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.843345] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.843499] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.843601] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.843837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.843966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.844120] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1375.911121] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.911371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.911436] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.911721] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.911934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.938172] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1377.955945] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1377.956257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.247582] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.247987] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.249277] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.249749] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.250315] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.250315] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.251736] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.252249] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.253337] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.253337] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.153842] env[65161]: INFO networking_nsxv3.common.synchronization [req-89bd1f79-fe4d-490b-a9eb-09109f1e11ad req-c63e5c09-a460-425e-8792-d9d14c8b178a tempest-AttachVolumeShelveTestJSON-33399502 tempest-AttachVolumeShelveTestJSON-33399502-project-member] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_members [ 1402.154324] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGHEST for action security_group_members [ 1402.154663] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.154792] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.154844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.155257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.155257] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.155498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.155498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.155606] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.155646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.155710] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.657977] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.658215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.658215] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.658509] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.658638] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.658866] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.659020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.659111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.659333] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.659446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.659561] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 is going to be updated. [ 1402.686452] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.686641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.686641] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.686890] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.687069] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.695745] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: IN_PROGRESS for 2s [ 1404.706588] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02655a7e-7e60-4267-846f-044d2c05ff76 in Status: SUCCESS [ 1404.707020] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 deletion is rescheduled due to dependency. [ 1404.707020] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.798175] env[65161]: INFO networking_nsxv3.common.synchronization [None req-bd6a876d-272a-4e94-b418-8f0ccc4d9fa1 tempest-AttachVolumeShelveTestJSON-33399502 tempest-AttachVolumeShelveTestJSON-33399502-project-member] Enqueued Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_rules [ 1406.798751] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_rules [ 1406.799072] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.799194] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.799268] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.799544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.799630] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.880365] env[65161]: INFO networking_nsxv3.common.synchronization [None req-34a3752f-1e84-4e70-9bd5-fc1f7774b486 tempest-AttachVolumeShelveTestJSON-33399502 tempest-AttachVolumeShelveTestJSON-33399502-project-member] Enqueued Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_rules [ 1406.880752] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_rules [ 1406.881080] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.881251] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.320284] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.320284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.320497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.320539] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.321349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.321349] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 already deleted. [ 1407.321349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.321349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.321349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.321349] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.840772] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.841126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.841126] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.841232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.841324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.841422] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 already deleted. [ 1407.841507] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.881687] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.881945] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.173141] env[65161]: INFO networking_nsxv3.common.synchronization [req-118c28c9-ffd2-478c-a366-8e160ccea94f req-ae649440-6d36-4757-b384-2a5537b9537d tempest-AttachVolumeShelveTestJSON-33399502 tempest-AttachVolumeShelveTestJSON-33399502-project-member] Enqueued Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_members [ 1412.173687] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_members [ 1412.174025] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.174158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.174245] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.174540] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.174723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.174840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.174902] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.175089] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.175187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.175300] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.439193] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.439390] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.439512] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.439778] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.440046] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.440205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.440321] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.440531] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.440677] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.440889] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1412.441010] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1412.441130] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1412.441237] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1412.441343] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1412.441447] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1412.441584] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1412.461962] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1412.462175] env[65161]: DEBUG dogpile.cache.region [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1412.462268] env[65161]: DEBUG dogpile.lock [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1412.462417] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.462732] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock port-b1d2ad03-04d1-4a93-b294-89c86c5af693 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.462901] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.463025] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.463349] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.463485] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d2ad03-04d1-4a93-b294-89c86c5af693',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.677416] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.677632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.677632] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.677802] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.677870] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.678102] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.678357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.678357] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.678608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.678608] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.678608] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 already deleted. [ 1412.678840] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.966797] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.966797] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.966797] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.966797] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.967311] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.967311] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Segment Port b1d2ad03-04d1-4a93-b294-89c86c5af693 not found, creating... [ 1412.967311] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.967447] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.967538] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.967744] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.967875] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.968167] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.968332] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.968478] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.968680] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.968811] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.968947] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Resource: SegmentPort with ID: b1d2ad03-04d1-4a93-b294-89c86c5af693 is going to be created. [ 1412.988566] env[65161]: DEBUG networking_nsxv3.common.locking [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.988799] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.988953] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.989249] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.989504] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.989736] env[65161]: DEBUG oslo_concurrency.lockutils [None req-27bdb5f8-112f-4cfe-a70f-fa82a75f46ea None None] Releasing lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.670354] env[65161]: INFO networking_nsxv3.common.synchronization [req-118c28c9-ffd2-478c-a366-8e160ccea94f req-f11cbd09-c478-4bfa-bdd2-741357da9263 service nova] Enqueued Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_rules [ 1413.670354] env[65161]: INFO networking_nsxv3.common.synchronization [req-118c28c9-ffd2-478c-a366-8e160ccea94f req-f11cbd09-c478-4bfa-bdd2-741357da9263 service nova] Enqueued Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_members [ 1413.670463] env[65161]: INFO networking_nsxv3.common.synchronization [req-118c28c9-ffd2-478c-a366-8e160ccea94f req-f11cbd09-c478-4bfa-bdd2-741357da9263 service nova] Enqueued Resource ID: b1d2ad03-04d1-4a93-b294-89c86c5af693 with Priority: HIGHEST for action port [ 1413.670986] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_rules [ 1413.671135] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_members [ 1413.671255] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d2ad03-04d1-4a93-b294-89c86c5af693 with Priority: HIGHEST for action port [ 1413.671548] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.671695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.671734] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.671929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.672015] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.672855] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.672985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.673029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.673208] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.673354] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.673486] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.673553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.673698] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.673783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.673872] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.674857] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1d2ad03-04d1-4a93-b294-89c86c5af693 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.674935] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.674985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.675207] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.675330] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d2ad03-04d1-4a93-b294-89c86c5af693',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.177202] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.178607] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.179238] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.179238] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1d2ad03-04d1-4a93-b294-89c86c5af693 with status ACTIVE [ 1414.179238] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.179398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.179398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.179665] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.180160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.180160] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.180160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.180160] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.180372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.180372] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.180501] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.180592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.180659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.180820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.180898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.180982] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1d2ad03-04d1-4a93-b294-89c86c5af693 is going to be updated. [ 1414.201321] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.201590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.201590] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.201861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.202014] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.202180] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.679615] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.181685] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.182127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.182127] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.182260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.182260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.182361] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 is going to be created. [ 1415.207655] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.207805] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.207877] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.208109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.208271] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.217057] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: UNINITIALIZED for 2s [ 1417.228218] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: UNINITIALIZED for 4s [ 1418.672039] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.672429] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1419.238606] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: SUCCESS [ 1419.238780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.238934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.239162] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.239347] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.239470] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.239534] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.239680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.239759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.239841] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.240032] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.743286] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.245774] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16: rpc.has_security_group_logging(os_id): False [ 1420.264871] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.265060] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.265119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.265330] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.265423] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.265661] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.265763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.265828] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.265976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.266063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.266147] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 is going to be created. [ 1420.325618] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.325858] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.325858] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.326045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.326229] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.339982] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: IN_PROGRESS for 2s [ 1422.353772] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: SUCCESS [ 1422.354057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.673074] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.673444] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.674803] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.675224] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.676556] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.676556] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.677132] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.677437] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.678178] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.678609] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.680110] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.680110] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.681024] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.681358] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.682881] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.682881] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.683795] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.683795] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.491097] env[65161]: INFO networking_nsxv3.common.synchronization [req-097e4c13-6423-46f3-b165-980ec74a3384 req-11c9c86d-d32f-47a4-9d24-3d30441d1ffb tempest-ServerActionsTestOtherB-176272064 tempest-ServerActionsTestOtherB-176272064-project-member] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1465.491945] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1465.491945] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.492122] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.492168] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.492421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.492577] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.492916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.492916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.492916] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.493198] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.493198] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.995587] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.995823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.995823] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.996059] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.996156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.996348] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.996449] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.996510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.996713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.996789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.996893] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1466.035512] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.035714] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.035833] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.035940] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.036112] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.045923] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1468.056918] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1468.057255] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 deletion is rescheduled due to dependency. [ 1468.057255] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.493166] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.493552] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.647191] env[65161]: INFO networking_nsxv3.common.synchronization [req-26f61ea6-3aee-4709-a5ee-46499da8e677 req-66598fda-c567-42eb-8707-b5e5457cb6d7 tempest-ServerActionsTestOtherB-176272064 tempest-ServerActionsTestOtherB-176272064-project-member] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1474.647650] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1474.647963] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.648099] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.648161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.648362] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.648514] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.648612] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.648673] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.648837] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.648909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.649015] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.910468] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.910468] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.910753] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.910753] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.911059] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.911229] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.911349] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.911569] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.911712] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.911960] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1474.912118] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1474.912233] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1474.912899] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1474.912899] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1474.912899] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1474.912899] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1474.933148] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1474.933307] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1474.933436] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1474.933600] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.933890] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-f2cd5f69-d106-4c12-815e-4c7436c88a32 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.934063] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.934183] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.934490] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.934627] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2cd5f69-d106-4c12-815e-4c7436c88a32',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.151324] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.151497] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.151572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.151771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.151868] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.152104] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.152240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.152283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.152415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.152491] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.152571] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1475.176795] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.176994] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.177050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.177262] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.177401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.186089] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1475.437376] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.437499] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.437609] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.437882] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.438044] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.438209] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Segment Port f2cd5f69-d106-4c12-815e-4c7436c88a32 not found, creating... [ 1475.438466] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.438625] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.438743] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.439013] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.439166] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.439447] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.439602] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.439720] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.439933] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.440107] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.440280] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: f2cd5f69-d106-4c12-815e-4c7436c88a32 is going to be created. [ 1475.459508] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.459721] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.459813] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.460132] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.460363] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.460579] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.153540] env[65161]: INFO networking_nsxv3.common.synchronization [req-26f61ea6-3aee-4709-a5ee-46499da8e677 req-70cdbcc4-70e2-4057-9df8-fff36ec1165d service nova] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1476.154074] env[65161]: INFO networking_nsxv3.common.synchronization [req-26f61ea6-3aee-4709-a5ee-46499da8e677 req-70cdbcc4-70e2-4057-9df8-fff36ec1165d service nova] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1476.154074] env[65161]: INFO networking_nsxv3.common.synchronization [req-26f61ea6-3aee-4709-a5ee-46499da8e677 req-70cdbcc4-70e2-4057-9df8-fff36ec1165d service nova] Enqueued Resource ID: f2cd5f69-d106-4c12-815e-4c7436c88a32 with Priority: HIGHEST for action port [ 1476.154483] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1476.154652] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1476.154719] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2cd5f69-d106-4c12-815e-4c7436c88a32 with Priority: HIGHEST for action port [ 1476.154986] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.155119] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.155179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.155371] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.155451] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.156346] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.156435] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.156601] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2cd5f69-d106-4c12-815e-4c7436c88a32 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.156753] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.156807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.156965] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.157117] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2cd5f69-d106-4c12-815e-4c7436c88a32',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.658865] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.659156] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.659365] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2cd5f69-d106-4c12-815e-4c7436c88a32 with status ACTIVE [ 1476.659561] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.659675] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.659763] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.659976] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.660080] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.660251] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.660344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.660402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.660555] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.660633] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.660808] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.660903] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.660959] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.661111] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.661186] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.661289] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2cd5f69-d106-4c12-815e-4c7436c88a32 is going to be updated. [ 1476.681052] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.681219] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.681283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.681462] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.681597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.681754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.195822] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1477.196123] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 deletion is rescheduled due to dependency. [ 1477.196123] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.196399] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.196744] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.196744] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.196879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.196879] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.196992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.197057] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.197151] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.699381] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.203474] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.705547] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.705720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.705794] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.706029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.706140] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.706242] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1478.739909] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.739909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.740235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.740235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.740358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.761688] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1480.772868] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1480.773293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.773293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.773492] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.773607] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1480.773741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1480.773826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1480.773913] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1480.773985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.774088] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1480.774179] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.155490] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.155683] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1481.276257] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.779518] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 210b4a58-38b8-4467-91ac-a2d403afcd27: rpc.has_security_group_logging(os_id): False [ 1481.798190] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.798418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.798418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.798635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.798723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.799035] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.799195] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.799247] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.799361] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.799437] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.799524] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1481.860693] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.860930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.860930] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.861136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.861308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.874722] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1483.890790] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1483.891191] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.407603] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.407603] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.407603] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.407816] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.408052] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.408236] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.408433] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.408646] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.408790] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.409027] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1484.409151] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1484.409262] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1484.409369] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1484.409477] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1484.409580] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1484.409917] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1484.433193] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1484.433412] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1484.433513] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1484.433673] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-94" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.433976] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-b1d2ad03-04d1-4a93-b294-89c86c5af693 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.434171] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.434294] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.434570] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.434706] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d2ad03-04d1-4a93-b294-89c86c5af693',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1484.937066] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.937523] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.937523] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.937704] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.937850] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.938151] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.938310] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.938426] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.938635] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.938767] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.939056] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.939205] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.939318] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.939516] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.939645] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.939785] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: b1d2ad03-04d1-4a93-b294-89c86c5af693 is going to be updated. [ 1484.960888] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.961122] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.961247] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.961525] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.961717] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.961937] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.648890] env[65161]: INFO networking_nsxv3.common.synchronization [req-6898c9d9-5871-4faa-af33-de757d9739cf req-8b61ac07-bf49-4b0e-8d77-803bc6761435 service nova] Enqueued Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_rules [ 1485.649114] env[65161]: INFO networking_nsxv3.common.synchronization [req-6898c9d9-5871-4faa-af33-de757d9739cf req-8b61ac07-bf49-4b0e-8d77-803bc6761435 service nova] Enqueued Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_members [ 1485.649317] env[65161]: INFO networking_nsxv3.common.synchronization [req-6898c9d9-5871-4faa-af33-de757d9739cf req-8b61ac07-bf49-4b0e-8d77-803bc6761435 service nova] Enqueued Resource ID: b1d2ad03-04d1-4a93-b294-89c86c5af693 with Priority: HIGHEST for action port [ 1485.649757] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_rules [ 1485.649892] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_members [ 1485.650015] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d2ad03-04d1-4a93-b294-89c86c5af693 with Priority: HIGHEST for action port [ 1485.650775] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.650909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.650979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.651202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.651286] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.652134] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.652293] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.652364] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.652536] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.652685] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.652844] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.652899] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.653032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.653121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.653211] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.654173] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1d2ad03-04d1-4a93-b294-89c86c5af693 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.654173] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.654256] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.654381] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.654479] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d2ad03-04d1-4a93-b294-89c86c5af693',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.157049] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.157937] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.158096] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.158250] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1d2ad03-04d1-4a93-b294-89c86c5af693 with status ACTIVE [ 1486.158459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.158600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.158672] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.159348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.159348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.159348] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.159348] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.159594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.159594] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.159668] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.159806] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.159924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.159958] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.160138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.160250] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.160300] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1d2ad03-04d1-4a93-b294-89c86c5af693 is going to be updated. [ 1486.186484] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.186707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.186829] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.187188] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.187421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.187688] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1d2ad03-04d1-4a93-b294-89c86c5af693" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.662065] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.164584] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.165052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.165052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.165244] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.165354] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.165485] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 is going to be updated. [ 1487.195803] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.196086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.196086] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.196320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.196320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.205782] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: IN_PROGRESS for 2s [ 1489.218936] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: SUCCESS [ 1489.219349] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.219401] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.219592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.219780] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.219897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.219964] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.220161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.220244] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.220343] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.220477] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.722705] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1490.224901] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16: rpc.has_security_group_logging(os_id): False [ 1490.246458] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.246726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.246726] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.246873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.246979] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.247308] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.247422] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.247480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.247658] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.247751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.247849] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 is going to be updated. [ 1490.308630] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.308861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.308861] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.309029] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.309367] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.326344] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: IN_PROGRESS for 2s [ 1490.651354] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.651506] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1492.353552] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: SUCCESS [ 1492.354039] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.652666] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.653082] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.653479] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.653913] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1503.173540] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1503.173940] env[65161]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-af80eb48-c4cf-4422-a021-d45c1b48ff1f None None] NSXv3 Agent Agent loop - iteration:4 started [ 1505.654886] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.655288] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.656386] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.656758] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.657336] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.657806] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.658553] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.658553] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.659147] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.659466] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.123192] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.123646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.123646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.123788] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.123942] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.626513] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.128937] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1529.632194] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1529.632403] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1530.377947] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.381246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.381246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.381246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.391725] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1530.392680] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.393539] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1530.430904] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.431153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.431153] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.431329] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.444469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.445325] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1530.445417] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1530.445500] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1530.481653] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.481938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.481938] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.482083] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.482796] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.482934] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1530.556835] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.557138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.557138] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.557288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.557630] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.558039] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1530.636723] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.636946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.636946] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.637109] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.637428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.637704] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:27. [ 1530.637788] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'02655a7e-7e60-4267-846f-044d2c05ff76', '210b4a58-38b8-4467-91ac-a2d403afcd27', 'dad00945-a380-4452-8a37-64cfdbf9d432', '20c8c1aa-e142-4f0d-9654-9180daa1078e', '490d862d-f7b2-497d-912a-e1801d9b16ad', '1d23f6bd-c3d6-4abc-b853-77560027d5d9', '48e5829e-83e0-44d7-b9e9-c3210ec30d0d', '9806617c-3cbb-4c3f-98c8-9af6c5b4dc39', '70c8e546-9b00-4441-97c1-cb8beb5cab1f', '4f5866be-f91a-4727-a28f-3e308ac779d0', '2ba62457-a546-42c0-916a-d1efa9c77ee4', 'c38cb053-aec9-4ead-86a8-4aa3f2154903', 'cb265379-c4fb-47cf-afb5-2c655df91dbf', 'cc716056-e80f-437c-a978-42b0cd24b9c7', '1b4da512-0ef0-4e5a-aad1-7eff0f72d14f', 'e24f796e-b77b-42f0-a7c2-ae92228b28c5', '45c3c240-33f4-4e4c-b0dc-526406810cce', 'aa3f13db-d36f-47b7-bca4-30b32f714725', '28f6a198-5899-42cf-bfcf-d51f32053a44', 'a004fc9f-8188-4952-8c7f-947ab65480c2', '6815e7f8-d060-497e-9594-0ed8cadfdffe', 'b59bd654-2015-4855-bb01-60ad0a84a0b0', 'd4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16', 'd592aa9d-8cc0-42f6-959d-30654012ec4e', 'bb437f4e-1421-44f7-a301-63abddb16aa0', 'c9f4e7d3-15ff-431e-9c10-7ea15b2417ee', 'e6704a80-3529-40ab-83a5-1a8a6167b498'} {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1530.637921] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1530.658862] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.659161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.659161] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.659298] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.659421] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.659532] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1530.659604] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1530.659677] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1530.660651] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.660742] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.740908] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1530.741146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1530.741146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1530.741336] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1530.742441] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1530.742685] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1530.742759] env[65161]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65161) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1530.742832] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1530.742895] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1530.742969] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/27 resources of Type:Security Group Rules [ 1530.743054] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGH for action security_group_rules [ 1530.743139] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGH for action security_group_rules [ 1530.743204] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGH for action security_group_rules [ 1530.743255] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGH for action security_group_rules [ 1530.743318] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGH for action security_group_rules [ 1530.743397] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGH for action security_group_rules [ 1530.743454] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGH for action security_group_rules [ 1530.743511] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGH for action security_group_rules [ 1530.743570] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGH for action security_group_rules [ 1530.743625] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGH for action security_group_rules [ 1530.743676] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGH for action security_group_rules [ 1530.743724] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGH for action security_group_rules [ 1530.743766] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGH for action security_group_rules [ 1530.743798] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGH for action security_group_rules [ 1530.743893] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGH for action security_group_rules [ 1530.743893] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGH for action security_group_rules [ 1530.744026] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGH for action security_group_rules [ 1530.744026] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGH for action security_group_rules [ 1530.744126] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGH for action security_group_rules [ 1530.744176] env[65161]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGH for action security_group_rules [ 1530.744235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.663059] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.663059] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1535.663059] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02655a7e-7e60-4267-846f-044d2c05ff76 with Priority: HIGH for action security_group_rules [ 1535.663059] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad00945-a380-4452-8a37-64cfdbf9d432 with Priority: HIGH for action security_group_rules [ 1535.663059] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d with Priority: HIGH for action security_group_rules [ 1535.663059] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f with Priority: HIGH for action security_group_rules [ 1535.663059] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a004fc9f-8188-4952-8c7f-947ab65480c2 with Priority: HIGH for action security_group_rules [ 1535.663702] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 with Priority: HIGH for action security_group_rules [ 1535.663702] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3f13db-d36f-47b7-bca4-30b32f714725 with Priority: HIGH for action security_group_rules [ 1535.663702] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c3c240-33f4-4e4c-b0dc-526406810cce with Priority: HIGH for action security_group_rules [ 1535.663702] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc716056-e80f-437c-a978-42b0cd24b9c7 with Priority: HIGH for action security_group_rules [ 1535.663702] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 with Priority: HIGH for action security_group_rules [ 1535.663702] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb265379-c4fb-47cf-afb5-2c655df91dbf with Priority: HIGH for action security_group_rules [ 1535.663956] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 with Priority: HIGH for action security_group_rules [ 1535.663956] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 with Priority: HIGH for action security_group_rules [ 1535.664052] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 with Priority: HIGH for action security_group_rules [ 1535.664093] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f with Priority: HIGH for action security_group_rules [ 1535.664535] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 with Priority: HIGH for action security_group_rules [ 1535.664715] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 with Priority: HIGH for action security_group_rules [ 1535.664826] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 490d862d-f7b2-497d-912a-e1801d9b16ad with Priority: HIGH for action security_group_rules [ 1535.664933] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGH for action security_group_rules [ 1535.665065] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e with Priority: HIGH for action security_group_rules [ 1535.665534] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02655a7e-7e60-4267-846f-044d2c05ff76 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.665706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.665799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.666063] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.666176] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02655a7e-7e60-4267-846f-044d2c05ff76',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.667381] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad00945-a380-4452-8a37-64cfdbf9d432 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.667533] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.668443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.668443] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.668443] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad00945-a380-4452-8a37-64cfdbf9d432',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.669310] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.669873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.669873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.669873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.670728] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48e5829e-83e0-44d7-b9e9-c3210ec30d0d',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.670773] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.671196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.671196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.671196] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.671353] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b4da512-0ef0-4e5a-aad1-7eff0f72d14f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.672021] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a004fc9f-8188-4952-8c7f-947ab65480c2 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.672136] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.672257] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.672661] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.672661] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a004fc9f-8188-4952-8c7f-947ab65480c2',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.673346] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28f6a198-5899-42cf-bfcf-d51f32053a44 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.673478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.673544] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.673700] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.673774] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28f6a198-5899-42cf-bfcf-d51f32053a44',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.674714] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3f13db-d36f-47b7-bca4-30b32f714725 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.674836] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.674880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.675024] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.675101] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3f13db-d36f-47b7-bca4-30b32f714725',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.676032] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45c3c240-33f4-4e4c-b0dc-526406810cce taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.676032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.676032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.676235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.676235] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45c3c240-33f4-4e4c-b0dc-526406810cce',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.676916] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc716056-e80f-437c-a978-42b0cd24b9c7 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.677038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.677596] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.677702] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.677774] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc716056-e80f-437c-a978-42b0cd24b9c7',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.678724] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.679212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.679212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.679212] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.679212] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24f796e-b77b-42f0-a7c2-ae92228b28c5',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.679994] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb265379-c4fb-47cf-afb5-2c655df91dbf taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.680179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.680179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.680438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.680438] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb265379-c4fb-47cf-afb5-2c655df91dbf',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.681101] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c38cb053-aec9-4ead-86a8-4aa3f2154903 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.681602] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.681723] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.682049] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.682049] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c38cb053-aec9-4ead-86a8-4aa3f2154903',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.682814] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ba62457-a546-42c0-916a-d1efa9c77ee4 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.683424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.683424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.683424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.683424] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ba62457-a546-42c0-916a-d1efa9c77ee4',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.683985] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5866be-f91a-4727-a28f-3e308ac779d0 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.684072] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.684131] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.684291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.684378] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5866be-f91a-4727-a28f-3e308ac779d0',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.685483] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.685643] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.685747] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.686337] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.686337] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70c8e546-9b00-4441-97c1-cb8beb5cab1f',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.686980] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.687146] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.687242] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.687463] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.687635] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d23f6bd-c3d6-4abc-b853-77560027d5d9',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.688499] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.688873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.688873] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.688969] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.689049] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9806617c-3cbb-4c3f-98c8-9af6c5b4dc39',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.692544] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-490d862d-f7b2-497d-912a-e1801d9b16ad taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.692716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.692806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.693054] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.693230] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('490d862d-f7b2-497d-912a-e1801d9b16ad',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.694208] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.694389] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.694504] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.694815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.694815] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.695795] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-20c8c1aa-e142-4f0d-9654-9180daa1078e taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.695966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.696084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.696299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.696408] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('20c8c1aa-e142-4f0d-9654-9180daa1078e',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.876252] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.876402] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.876472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.876689] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.879106] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.879235] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.898285] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.898415] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48e5829e-83e0-44d7-b9e9-c3210ec30d0d is going to be deleted. [ 1535.899320] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.899561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.918783] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.918961] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad00945-a380-4452-8a37-64cfdbf9d432 is going to be deleted. [ 1535.957792] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.958045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.958045] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.958232] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.958321] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.958438] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48e5829e-83e0-44d7-b9e9-c3210ec30d0d" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.964272] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.964411] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.964455] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.964631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.964716] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.964830] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad00945-a380-4452-8a37-64cfdbf9d432" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.215693] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.215966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.215966] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.216279] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.216533] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.216677] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.216741] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.216934] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.217044] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.217125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.217262] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.352970] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.353227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.353227] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.353418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.355106] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.355226] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.356008] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.356125] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.356813] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.356904] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.357599] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.357695] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.358328] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.358418] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.359111] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.359202] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.359896] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.359975] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.360678] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.360759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.361527] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.361634] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.362716] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.362803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.363548] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.363790] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.363898] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.364448] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.364876] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.364971] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.365542] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.366015] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.366108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.366846] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.367212] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.367324] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.367899] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.368284] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.368368] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.368923] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.369289] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.369398] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.380598] env[65161]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1536.381143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.381294] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45c3c240-33f4-4e4c-b0dc-526406810cce is going to be deleted. [ 1536.382261] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.382472] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.434093] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.434239] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc716056-e80f-437c-a978-42b0cd24b9c7 is going to be deleted. [ 1536.435185] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.435406] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.459581] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.459784] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24f796e-b77b-42f0-a7c2-ae92228b28c5 is going to be deleted. [ 1536.460648] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.460856] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.466416] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.466599] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.491498] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.491677] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02655a7e-7e60-4267-846f-044d2c05ff76 is going to be deleted. [ 1536.492532] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.492751] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.518300] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.518510] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.520284] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.520432] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28f6a198-5899-42cf-bfcf-d51f32053a44 is going to be deleted. [ 1536.521306] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.521519] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.558132] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.558309] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a004fc9f-8188-4952-8c7f-947ab65480c2 is going to be deleted. [ 1536.559377] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.559636] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.563176] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.563325] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.595434] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.595693] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c38cb053-aec9-4ead-86a8-4aa3f2154903 is going to be deleted. [ 1536.596617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.596901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.637159] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.637341] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.640811] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.640948] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.684396] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.684772] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 490d862d-f7b2-497d-912a-e1801d9b16ad is going to be deleted. [ 1536.685480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.685694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.707985] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.708189] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.711631] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.711762] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9806617c-3cbb-4c3f-98c8-9af6c5b4dc39 is going to be deleted. [ 1536.712782] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.713154] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.725113] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.766705] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.766972] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.769561] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.769684] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d23f6bd-c3d6-4abc-b853-77560027d5d9 is going to be deleted. [ 1536.770591] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.770811] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.813597] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.813803] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.831133] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.831351] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.842809] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.842974] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3f13db-d36f-47b7-bca4-30b32f714725 is going to be deleted. [ 1536.843909] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.844671] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.856083] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.856220] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.890977] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.891151] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70c8e546-9b00-4441-97c1-cb8beb5cab1f is going to be deleted. [ 1536.893058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.893058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.916365] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.916540] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b4da512-0ef0-4e5a-aad1-7eff0f72d14f is going to be deleted. [ 1536.917408] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.917685] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.986374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.986374] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5866be-f91a-4727-a28f-3e308ac779d0 is going to be deleted. [ 1536.986374] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.986691] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.001960] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.002097] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.024620] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.024789] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.042137] env[65161]: INFO networking_nsxv3.common.synchronization [req-75e00865-dadc-497a-b6eb-27f1a031dde2 req-b96c0ef5-c930-4c81-a81e-eb0ac47943d7 tempest-AttachVolumeShelveTestJSON-33399502 tempest-AttachVolumeShelveTestJSON-33399502-project-member] Enqueued Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_members [ 1537.043246] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.043368] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 20c8c1aa-e142-4f0d-9654-9180daa1078e is going to be deleted. [ 1537.044806] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 with Priority: HIGHEST for action security_group_members [ 1537.044806] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.045032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.046571] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.046699] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.046765] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.046929] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.047104] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.047199] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.047258] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.047428] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.047515] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.047607] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.090804] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.091067] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.091717] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.091820] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.116713] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.116882] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ba62457-a546-42c0-916a-d1efa9c77ee4 is going to be deleted. [ 1537.117992] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.118240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.176816] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.176983] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb265379-c4fb-47cf-afb5-2c655df91dbf is going to be deleted. [ 1537.178269] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.178496] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.179022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.179022] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45c3c240-33f4-4e4c-b0dc-526406810cce" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.179142] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.179302] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.179450] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.179604] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc716056-e80f-437c-a978-42b0cd24b9c7" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.180807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.180807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.180807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.180807] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24f796e-b77b-42f0-a7c2-ae92228b28c5" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.181121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.181121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.181121] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.181260] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28f6a198-5899-42cf-bfcf-d51f32053a44" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.181346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.182128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.182128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.182128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02655a7e-7e60-4267-846f-044d2c05ff76" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.182128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.182128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.182128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.182128] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a004fc9f-8188-4952-8c7f-947ab65480c2" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.182451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.182451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.182451] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.182556] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c38cb053-aec9-4ead-86a8-4aa3f2154903" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.182597] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.182728] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.182799] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.182901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-490d862d-f7b2-497d-912a-e1801d9b16ad" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.183032] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.183167] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.183240] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.183346] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9806617c-3cbb-4c3f-98c8-9af6c5b4dc39" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.183468] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.183674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.183674] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.183773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d23f6bd-c3d6-4abc-b853-77560027d5d9" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.183894] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.184038] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.184110] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.184217] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3f13db-d36f-47b7-bca4-30b32f714725" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.184344] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.184480] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.184553] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.184659] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70c8e546-9b00-4441-97c1-cb8beb5cab1f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.184785] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.184924] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.185104] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.185216] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b4da512-0ef0-4e5a-aad1-7eff0f72d14f" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.185707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.185707] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.185797] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.185888] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5866be-f91a-4727-a28f-3e308ac779d0" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.217247] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.217415] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.217624] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.217843] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.217985] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.218143] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-20c8c1aa-e142-4f0d-9654-9180daa1078e" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.227640] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 210b4a58-38b8-4467-91ac-a2d403afcd27: rpc.has_security_group_logging(os_id): False [ 1537.264471] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.264720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.264720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.265187] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.266712] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.266897] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.287586] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.287746] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.307283] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.307600] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.307701] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.307815] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.307988] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.308106] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.308232] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1537.309773] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.309950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.310058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.310171] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ba62457-a546-42c0-916a-d1efa9c77ee4" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.310299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.310446] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.310546] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.310646] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb265379-c4fb-47cf-afb5-2c655df91dbf" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.446165] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.446165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.446165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.446165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.446165] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.463793] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1537.550528] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.550754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.550754] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.550950] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.572600] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.572864] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.572984] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.573068] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.573275] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.573358] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.573448] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 is going to be updated. [ 1537.602846] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.603108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.603108] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.603288] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.603427] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.612607] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: IN_PROGRESS for 2s [ 1539.477578] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1539.477863] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.622180] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 in Status: SUCCESS [ 1539.622345] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16 deletion is rescheduled due to dependency. [ 1539.622513] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c7ee5b-e48d-4c9f-a8c9-e6a9cb766f16" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.045750] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.045750] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1546.540583] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock network-677 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.540939] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.540985] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.541255] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.541511] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.541669] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.541788] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.541994] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.542152] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.542352] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1546.542461] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] NeedRegenerationException {{(pid=65161) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1546.542569] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] no value, waiting for create lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1546.542673] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] value creation lock acquired {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1546.542778] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] No value present for key: 'zone-id' {{(pid=65161) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1546.542880] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Calling creation function for not-yet-present value {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1546.543013] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1546.562307] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1546.562543] env[65161]: DEBUG dogpile.cache.region [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65161) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1546.562682] env[65161]: DEBUG dogpile.lock [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Released creation lock {{(pid=65161) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1546.562847] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "network-677" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.563169] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock port-f2cd5f69-d106-4c12-815e-4c7436c88a32 taken with stack trace [, , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.563336] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.563454] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.563700] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.563828] env[65161]: DEBUG networking_nsxv3.api.rpc [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2cd5f69-d106-4c12-815e-4c7436c88a32',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.047122] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.047303] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.066482] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.066709] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.066833] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.067145] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.067295] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.067606] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.067761] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.067880] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.068146] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.068288] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.068577] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.068732] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.068845] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.069060] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.069193] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.069332] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Resource: SegmentPort with ID: f2cd5f69-d106-4c12-815e-4c7436c88a32 is going to be updated. [ 1547.089148] env[65161]: DEBUG networking_nsxv3.common.locking [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.089356] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.089469] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.089727] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.089918] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.090141] env[65161]: DEBUG oslo_concurrency.lockutils [None req-bc5b6bab-8579-4712-862c-cca0d49a4ae4 None None] Releasing lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.773075] env[65161]: INFO networking_nsxv3.common.synchronization [req-63f8f6ee-c3fb-42f2-b21c-2ccef4dafd60 req-c658bc2f-0ee4-4da5-84d1-f2bc0fffcd0f service nova] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1547.773353] env[65161]: INFO networking_nsxv3.common.synchronization [req-63f8f6ee-c3fb-42f2-b21c-2ccef4dafd60 req-c658bc2f-0ee4-4da5-84d1-f2bc0fffcd0f service nova] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1547.773394] env[65161]: INFO networking_nsxv3.common.synchronization [req-63f8f6ee-c3fb-42f2-b21c-2ccef4dafd60 req-c658bc2f-0ee4-4da5-84d1-f2bc0fffcd0f service nova] Enqueued Resource ID: f2cd5f69-d106-4c12-815e-4c7436c88a32 with Priority: HIGHEST for action port [ 1547.775260] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_rules [ 1547.775405] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1547.775501] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2cd5f69-d106-4c12-815e-4c7436c88a32 with Priority: HIGHEST for action port [ 1547.775772] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock rules-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.775900] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.775993] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.776176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.776258] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.777042] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.777158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.777266] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.777469] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.777538] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.777649] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.777694] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.777826] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.777907] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.777994] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.778672] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2cd5f69-d106-4c12-815e-4c7436c88a32 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.778776] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.778880] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.778978] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.779062] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2cd5f69-d106-4c12-815e-4c7436c88a32',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.282052] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.282052] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.282052] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.284274] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2cd5f69-d106-4c12-815e-4c7436c88a32 with status ACTIVE [ 1548.284274] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.284274] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.284527] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.284572] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.284666] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.284841] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.284939] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.284999] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.285190] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.285237] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.285951] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.285951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.285951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.285951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.285951] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.285951] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2cd5f69-d106-4c12-815e-4c7436c88a32 is going to be updated. [ 1548.306538] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.306706] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.306756] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.306919] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.307058] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.307207] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2cd5f69-d106-4c12-815e-4c7436c88a32" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.782526] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.285375] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.285574] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.285662] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.285901] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.285995] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.286309] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1549.317263] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.317420] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.317478] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.317771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.317931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.326416] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1551.338321] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1551.338973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.338973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.338973] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.339141] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.339253] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.339317] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.339508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.339635] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.339725] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.339815] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.842460] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.345066] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 210b4a58-38b8-4467-91ac-a2d403afcd27: rpc.has_security_group_logging(os_id): False [ 1552.362691] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.362931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.362931] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.363176] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.363291] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.363554] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.363684] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.363771] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.363933] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.364050] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.364146] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1552.425459] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.425760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.425760] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.425981] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.426179] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.442275] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1552.776354] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.776516] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1554.460023] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1554.460617] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.777483] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.777898] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.779095] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.779532] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1563.896799] env[65161]: INFO networking_nsxv3.common.synchronization [req-7d7ab2b4-f2fb-4b2e-a668-41b121b3291f req-c6288956-be53-4e66-8a74-acd5a991dd78 tempest-ServerActionsTestOtherB-176272064 tempest-ServerActionsTestOtherB-176272064-project-member] Enqueued Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1563.897359] env[65161]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 with Priority: HIGHEST for action security_group_members [ 1563.897657] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock member-210b4a58-38b8-4467-91ac-a2d403afcd27 taken with stack trace [, , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.897780] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.897865] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.898230] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.898392] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.898508] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.898592] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.898759] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.898845] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.898947] env[65161]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('210b4a58-38b8-4467-91ac-a2d403afcd27',) {} {{(pid=65161) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.402175] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.402375] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.402424] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.402622] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.402720] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.402961] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.403084] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.403150] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.403308] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.403473] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.403536] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 is going to be updated. [ 1564.431898] env[65161]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65161) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.432158] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.432299] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.432495] env[65161]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.432770] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.440541] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: IN_PROGRESS for 2s [ 1566.452833] env[65161]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 in Status: SUCCESS [ 1566.453239] env[65161]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 210b4a58-38b8-4467-91ac-a2d403afcd27 deletion is rescheduled due to dependency. [ 1566.453239] env[65161]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-210b4a58-38b8-4467-91ac-a2d403afcd27" {{(pid=65161) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1568.898505] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1568.898901] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1573.899289] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1573.899713] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1578.900543] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1578.901061] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.901802] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.902231] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1588.903616] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.904083] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1593.904647] env[65161]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.905040] env[65161]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0